MySQL DB Patterns

by Andrew Brampton 2013, contributed by Mateusz Zakarczemny

Intro

Some useful java code backed by JDBC that implements some common patterns.

So far a Condition object, and a Queue are implemented.

	<dependency>
<groupId>net.bramp.db-patterns</groupId>
<artifactId>db-patterns</artifactId>
<version>0.1</version>
</dependency>

Condition

A distributed Java Condition

DataSourceds = ...
Conditioncondition = newMySQLSleepBasedCondition(ds, "lockname");
condition.await(); // Blocks until a notify// on another thread (or process, or machine)condition.notify();

The MySQLSleepBasedCondition is based on the MySQL SLEEP() and KILL QUERY

The thread that is woken up is guaranteed to be the one that has waited the longest.

Blocking queue

A distributed MySQL backed Java BlockingQueue

DataSourceds = ...
//datasoruce, queue table, queuename, value type, thread nameBlockingQueue<String> queue = newMySQLBasedQueue<String>(ds, "queue", "queue name", String.class, "Worker1");
queue.add("Some String");
// on another thread (or process, or machine)Strings = queue.poll(); // Non blocking// orStrings = queue.take(); // Blocks until element available

The MySQLBasedQueue uses the MySQLSleepBasedCondition to help form a blocking queue, that can work without polling the database for new work.

More complex types could be stored using serializator:

Serializatorserializator = newDefaultSerializator<MyType>();
BlockingQueue<String> queue = newMySQLBasedQueue<String>(ds, "queue", "queue name", serializator, "Worker1");
MyTypevalue = newMyType(...);
queue.add(value);

DefaultSerializator serializes values using java ObjectOutputStream but other implementation might be passed to queue (eg. some custom JsonSerializer).

DelayQueue

A distributed MySQL backed Java DelayQueue

Serializatorserializator = newDefaultSerializator<MyDelayedType>(); // MyType must extends Delayed interfaceDelayQueue<String> queue = newMySQLBasedDelayQueue<String>(ds, "queue", "queue name", serializator, "Worker1");
MyDelayedTypevalue = newMyDelayedType(10, TimeUnit.SECONDS);
queue.add(value);
queue.peek(); // equals nullThread.sleep(11*1000);
queue.peek(); // equals value

Statuses

MySQLBasedQueue, MySQLBasedDelayQueue implements StatusableQueue interface which enables setting queue item statuses. Statuses do not affect polling of items. They might be set at any time and to any value. They just provides convenient way of tracking item state.

PriorityQueue brings such methods:

publicVpollWithMetadata();
publicVpollWithMetadata(longtimeout, TimeUnitunit) throwsInterruptedException;
publicVpeekWithMetadata();
publicvoidupdateStatus(longid, StringnewStatus);
publicStringgetStatus(longid);

Where V is class implementing ValueWithMetadata interface. ValueWithMetadata contains item id in queue, status and item value.

Priority

MySQLBasedQueue, MySQLBasedDelayQueue implements PriorityQueue interface which enables setting items priority. The higher priority is, the earlier item will be polled from queue. From 0.3.5 version, due to lack of DESC index in mysql, internally in table values are stored inverted. While migrating to version 0.3.5 all priorities should be multiplied by -1.

StatusableQueue brings such methods:

publicbooleanadd(Evalue, intpriority);

Default priority for add is 0. Priority could be retrieved from value metadata (see above) using getPriority method.

Build and Release

To build this project use mvn.

To push a release to maven central use the standard maven release plugin, and Sonatype's OSS repo:

mvn release:prepare
mvn release:perform

Useful Articles

https://blog.engineyard.com/2011/5-subtle-ways-youre-using-mysql-as-a-queue-and-why-itll-bite-you