Web lists-archives.com

MySQL Cluster 7.4.9 has been released





Dear MySQL Users, 

MySQL Cluster is the distributed, shared-nothing variant of MySQL. 
This storage engine provides: 

- In-memory persistent storage - Real-time performance 
- Transparent Auto-Sharding - Read & write scalability 
- Active-Active/Multi-Master geographic replication 
- 99.999% High Availability with no single point of failure 
and on-line maintenance 
- NoSQL and SQL APIs (including C++, Java, http, Memcached 
and JavaScript/Node.js) 

MySQL Cluster 7.4 makes significant advances in performance; 
operational efficiency (such as enhanced reporting and faster restarts 
and upgrades) and conflict detection and resolution for active-active 
replication between MySQL Clusters. 

MySQL Cluster 7.4.9, has been released and can be downloaded from 

http://www.mysql.com/downloads/cluster/ 

where you will also find Quick Start guides to help you get your 
first MySQL Cluster database up and running. 

The release notes are available from 

http://dev.mysql.com/doc/relnotes/mysql-cluster/7.4/en/index.html 

MySQL Cluster enables users to meet the database challenges of next 
generation web, cloud, and communications services with uncompromising 
scalability, uptime and agility. 

More details can be found at 

http://www.mysql.com/products/cluster/ 

Enjoy ! 


Changes in MySQL Cluster NDB 7.4.9 (5.6.28-ndb-7.4.9) (2016-01-18 ) 

MySQL Cluster NDB 7.4.9 is a new release of MySQL Cluster 
7.4, based on MySQL Server 5.6 and including features in 
version 7.4 of the NDB storage engine, as well as fixing 
recently discovered bugs in previous MySQL Cluster releases. 

Obtaining MySQL Cluster NDB 7.4. MySQL Cluster NDB 7.4 
source code and binaries can be obtained from 
http://dev.mysql.com/downloads/cluster/. 

For an overview of changes made in MySQL Cluster NDB 7.4, see 
MySQL Cluster Development in MySQL Cluster NDB 7.4 
( http://dev.mysql.com/doc/refman/5.6/en/mysql-cluster-development- 
5-6-ndb-7-4.htm l). 

This release also incorporates all bugfixes and changes made 
in previous MySQL Cluster releases, as well as all bugfixes 
and feature changes which were added in mainline MySQL 5.6 
through MySQL 5.6.28 (see Changes in MySQL 5.6.28 
(2015-12-07) 
(http://dev.mysql.com/doc/relnotes/mysql/5.6/en/news-5-6-28.html)). 

Functionality Added or Changed 

* Important Change: Previously, the NDB scheduler always 
optimized for speed against throughput in a predetermined 
manner (this was hard coded); this balance can now be set 
using the SchedulerResponsiveness data node configuration 
parameter. This parameter accepts an integer in the range 
of 0-10 inclusive, with 5 as the default. Higher values 
provide better response times relative to throughput. 
Lower values provide increased throughput, but impose 
longer response times. (Bug #78531, Bug #21889312) 

* Added the tc_time_track_stats table to the ndbinfo 
information database. This table provides time-tracking 
information relating to transactions, key operations, and 
scan operations performed by NDB. (Bug #78533, Bug 
#21889652) 

* Cluster Replication: Normally, RESET SLAVE causes all 
entries to be deleted from the mysql.ndb_apply_status 
table. This release adds the ndb_clear_apply_status 
system variable, which makes it possible to override this 
behavior. This variable is ON by default; setting it to 
OFF keeps RESET SLAVE from purging the ndb_apply_status 
table. (Bug #12630403) 

Bugs Fixed 

* Important Change: Users can now set the number and length 
of connection timeouts allowed by most NDB programs with 
the --connect-retries and --connect-retry-delay command 
line options introduced for the programs in this release. 
For ndb_mgm, --connect-retries supersedes the existing 
--try-reconnect option. (Bug #57576, Bug #11764714) 

* When executing a schema operation such as CREATE TABLE on 
a MySQL Cluster with multiple SQL nodes, it was possible 
for the SQL node on which the operation was performed to 
time out while waiting for an acknowledgement from the 
others. This could occur when different SQL nodes had 
different settings for --ndb-log-updated-only, 
--ndb-log-update-as-write, or other mysqld options 
effecting binary logging by NDB. 
This happened due to the fact that, in order to 
distribute schema changes between them, all SQL nodes 
subscribe to changes in the ndb_schema system table, and 
that all SQL nodes are made aware of each others 
subscriptions by subscribing to TE_SUBSCRIBE and 
TE_UNSUBSCRIBE events. The names of events to subscribe 
to are constructed from the table names, adding REPL$ or 
REPLF$ as a prefix. REPLF$ is used when full binary 
logging is specified for the table. The issue described 
previously arose because different values for the options 
mentioned could lead to different events being subscribed 
to by different SQL nodes, meaning that all SQL nodes 
were not necessarily aware of each other, so that the 
code that handled waiting for schema distribution to 
complete did not work as designed. 
To fix this issue, MySQL Cluster now treats the 
ndb_schema table as a special case and enforces full 
binary logging at all times for this table, independent 
of any settings for mysqld binary logging options. (Bug 
#22174287, Bug #79188) 

* Attempting to create an NDB table having greater than the 
maximum supported combined width for all BIT columns 
(4096) caused data node failure when these columns were 
defined with COLUMN_FORMAT DYNAMIC. (Bug #21889267) 

* Creating a table with the maxmimum supported number of 
columns (512) all using COLUMN_FORMAT DYNAMIC led to data 
node failures. (Bug #21863798) 

* In certain cases, a cluster failure (error 4009) was 
reported as Unknown error code. (Bug #21837074) 

* For a timeout in GET_TABINFOREQ while executing a CREATE 
INDEX statement, mysqld returned Error 4243 (Index not 
found) instead of the expected Error 4008 (Receive from 
NDB failed). 
The fix for this bug also fixes similar timeout issues 
for a number of other signals that are sent the DBDICT 
kernel block as part of DDL operations, including 
ALTER_TAB_REQ, CREATE_INDX_REQ, DROP_FK_REQ, 
DROP_INDX_REQ, INDEX_STAT_REQ, DROP_FILE_REQ, 
CREATE_FILEGROUP_REQ, DROP_FILEGROUP_REQ, CREATE_EVENT, 
WAIT_GCP_REQ, DROP_TAB_REQ, and LIST_TABLES_REQ, as well 
as several internal functions used in handling NDB schema 
operations. (Bug #21277472) 
References: See also Bug #20617891, Bug #20368354, Bug 
#19821115. 

* Using ndb_mgm STOP -f to force a node shutdown even when 
it triggered a complete shutdown of the cluster, it was 
possible to lose data when a sufficient number of nodes 
were shut down, triggering a cluster shutodwn, and the 
timing was such that SUMA handovers had been made to 
nodes already in the process of shutting down. (Bug 
#17772138) 

* The internal NdbEventBuffer::set_total_buckets() method 
calculated the number of remaining buckets incorrectly. 
This caused any incomplete epoch to be prematurely 
completed when the SUB_START_CONF signal arrived out of 
order. Any events belonging to this epoch arriving later 
were then ignored, and so effectively lost, which 
resulted in schema changes not being distributed 
correctly among SQL nodes. (Bug #79635, Bug #22363510) 

* Compilation of MySQL Cluster failed on SUSE Linux 
Enterprise Server 12. (Bug #79429, Bug #22292329) 

* Schema events were appended to the binary log out of 
order relative to non-schema events. This was caused by 
the fact that the binlog injector did not properly handle 
the case where schema events and non-schema events were 
from different epochs. 
This fix modifies the handling of events from the two 
schema and non-schema event streams such that events are 
now always handled one epoch at a time, starting with 
events from the oldest available epoch, without regard to 
the event stream in which they occur. (Bug #79077, Bug 
#22135584, Bug #20456664) 

* When executed on an NDB table, ALTER TABLE ... DROP INDEX 
made changes to an internal array referencing the indexes 
before the index was actually dropped, and did not revert 
these changes in the event that the drop was not 
completed. One effect of this was that, after attempting 
to drop an index on which there was a foreign key 
dependency, the expected error referred to the wrong 
index, and subsequent attempts using SQL to modify 
indexes of this table failed. (Bug #78980, Bug #22104597) 

* NDB failed during a node restart due to the status of the 
current local checkpoint being set but not as active, 
even though it could have other states under such 
conditions. (Bug #78780, Bug #21973758) 

* ndbmtd checked for signals being sent only after a full 
cycle in run_job_buffers, which is performed for all job 
buffer inputs. Now this is done as part of 
run_job_buffers itself, avoiding executing for extended 
periods without sending to other nodes or flushing signals 
to other threads. (Bug #78530, Bug #21889088) 

* In MySQL Cluster 7.4 scan executions was optimised by 
handling multiple rows at a time. This has two effects, 
1) it gives scans higher prio compared to key lookup 
operations, 2) it changes the behaviour of the scheduler. 
2) was fixed, restoring the former scheduling behaviour. 
1) is kept since it has a significant performance benefit 
but means were provided for change of this in exceptional 
circumstances. (Bug #78526, Bug #21886644) 

* Disk Data: A unique index on a column of an NDB table is 
implemented with an associated internal ordered index, 
used for scanning. While dropping an index, this ordered 
index was dropped first, followed by the drop of the 
unique index itself. This meant that, when the drop was 
rejected due to (for example) a constraint violation, the 
statement was rejected but the associated ordered index 
remained deleted, so that any subsequent operation using 
a scan on this table failed. We fix this problem by 
causing the unique index to be removed first, before 
removing the ordered index; removal of the related 
ordered index is no longer performed when removal of a 
unique index fails. (Bug #78306, Bug #21777589) 

* Cluster Replication: While the binary log injector thread 
was handling failure events, it was possible for all NDB 
tables to be left indefinitely in read-only mode. This 
was due to a race condition between the binlog injector 
thread and the utility thread handling events on the 
ndb_schema table, and to the fact that, when handling 
failure events, the binlog injector thread places all NDB 
tables in read-only mode until all such events are 
handled and the thread restarts itself. 
When the binlog inject thread receives a group of one or 
more failure events, it drops all other existing event 
operations and expects no more events from the utility 
thread until it has handled all of the failure events and 
then restarted itself. However, it was possible for the 
utility thread to continue attempting binary log setup 
while the injector thread was handling failures and thus 
attempting to create the schema distribution tables as 
well as event subscriptions on these tables. If the 
creation of these tables and event subscriptions occurred 
during this time, the binlog injector thread's 
expectation that there were no further event operations 
was never met; thus, the injector thread never restarted, 
and NDB tables remained in read-only as described 
previously. 
To fix this problem, the Ndb object that handles schema 
events is now definitely dropped once the ndb_schema 
table drop event is handled, so that the utility thread 
cannot create any new events until after the injector 
thread has restarted, at which time, a new Ndb object for 
handling schema events is created. (Bug #17674771, Bug 
#19537961, Bug #22204186, Bug #22361695) 

* Cluster API: The binlog injector did not work correctly 
with TE_INCONSISTENT event type handling by 
Ndb::nextEvent(). (Bug #22135541) 
References: See also Bug #20646496. 

* Cluster API: Ndb::pollEvents() and pollEvents2() were 
slow to receive events, being dependent on other client 
threads or blocks to perform polling of transporters on 
their behalf. This fix allows a client thread to perform 
its own transporter polling when it has to wait in either 
of these methods. 
Introduction of transporter polling also revealed a 
problem with missing mutex protection in the 
ndbcluster_binlog handler, which has been added as part 
of this fix. (Bug #20957068, Bug #22224571, Bug #79311) 

* Cluster API: Garbage collection is performed on several 
objects in the implementation of NdbEventOperation, based 
on which GCIs have been consumed by clients, including 
those that have been dropped by 
Ndb::dropEventOperation(). In this implementation, the 
assumption was made that the global checkpoint index 
(GCI) is always monotonically increasing, although this 
is not the case during an initial restart, when the GCI 
is reset. This could lead to event objects in the NDB API 
being released prematurely or not at all, in the latter 
case causing a resource leak. 
To prevent this from happening, the NDB event object's 
implementation now tracks, internally, both the GCI and 
the generation of the GCI; the generation is incremented 
whenever the node process is restarted, and this value is 
now used to provide a monotonically increasing sequence. 
(Bug #73781, Bug #21809959) 

On behalf of the MySQL Release Team, 
Lars Tangvald