org.jumpmind.symmetric.service.impl

Class DataLoaderService

java.lang.Object

org.jumpmind.symmetric.service.impl.AbstractService

org.jumpmind.symmetric.service.impl.DataLoaderService

All Implemented Interfaces:

IDataLoaderService, IService

public class DataLoaderService
extends AbstractService
implements IDataLoaderService

Responsible for writing batch data to the database

See Also:

IDataLoaderService

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	DataLoaderService.ConflictNodeGroupLink

Field Summary

Fields inherited from class org.jumpmind.symmetric.service.impl.AbstractService

log, parameterService, platform, sqlTemplate, sqlTemplateDirty, symmetricDialect, tablePrefix

Constructor Summary

Constructors

Constructor and Description
DataLoaderService(ISymmetricEngine engine)

Method Summary

Modifier and Type	Method and Description
protected org.jumpmind.symmetric.io.data.IDataWriter	buildDataWriter(ProcessInfo processInfo, java.lang.String sourceNodeId, java.lang.String channelId, long batchId, boolean isRetry)
void	clearCache()
void	delete(DataLoaderService.ConflictNodeGroupLink settings)
void	deleteAllConflicts()
static java.lang.String	filterDataLoaderType(java.lang.String dataLoaderType)
java.util.List<java.lang.String>	getAvailableDataLoaderFactories()
java.util.List<DataLoaderService.ConflictNodeGroupLink>	getConflictSettingsNodeGroupLinks()
java.util.List<DataLoaderService.ConflictNodeGroupLink>	getConflictSettingsNodeGroupLinks(NodeGroupLink link, boolean refreshCache)
IncomingError	getCurrentIncomingError(long batchId, java.lang.String nodeId)
protected java.util.Map<java.lang.String,IDataLoaderFactory>	getDataLoaderFactories()
protected IDataLoaderFactory	getFactory(java.lang.String channelId)
java.util.List<IncomingError>	getIncomingErrors(long batchId, java.lang.String nodeId)
void	insertIncomingError(IncomingError incomingError)
void	insertIncomingError(org.jumpmind.db.sql.ISqlTransaction transaction, IncomingError incomingError)
java.util.List<IncomingBatch>	loadDataBatch(java.lang.String batchData)
void	loadDataFromConfig(Node remote, RemoteNodeStatus status, boolean force)
java.util.List<IncomingBatch>	loadDataFromOfflineTransport(Node remote, RemoteNodeStatus status, IIncomingTransport transport)
void	loadDataFromPull(Node remote, RemoteNodeStatus status)
RemoteNodeStatus	loadDataFromPull(Node remote, java.lang.String queue) Connect to the remote node and pull data.
void	loadDataFromPush(Node sourceNode, java.io.InputStream in, java.io.OutputStream out) Load database from input stream and write acknowledgment to output stream.
void	loadDataFromPush(Node sourceNode, java.lang.String queue, java.io.InputStream in, java.io.OutputStream out) Load database from input stream and write acknowledgment to output stream.
protected java.util.List<IncomingBatch>	loadDataFromTransport(ProcessInfo transferInfo, Node sourceNode, IIncomingTransport transport, java.io.OutputStream out) Load database from input stream and return a list of batch statuses.
protected void	logOrRethrow(java.lang.Throwable ex)
protected void	purgeLoadBatchesFromStaging(java.util.List<IncomingBatch> batchList)
boolean	refreshFromDatabase()
void	save(DataLoaderService.ConflictNodeGroupLink setting)
protected void	setTransportManager(ITransportManager transportManager) Used for unit tests
protected void	updateBatchToSendCount(Node remote, IIncomingTransport transport)
void	updateIncomingError(IncomingError incomingError)

Methods inherited from class org.jumpmind.symmetric.service.impl.AbstractService

assertNotNull, buildBatchWhere, close, createSqlReplacementTokens, createSqlReplacementTokens, getJdbcTemplate, getParameterService, getSql, getSymmetricDialect, getTablePrefix, getTargetDialect, getTargetPlatform, getTargetPlatform, isCalledFromSymmetricAdminTool, isSet, isStreamClosedByClient, isSymmetricTable, logOnce, maxDate, readAcks, sendAck, setSqlMap, synchronize, toNodeIds, toNodeIds

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

DataLoaderService

public DataLoaderService(ISymmetricEngine engine)

Method Detail

refreshFromDatabase

public boolean refreshFromDatabase()

Specified by:

refreshFromDatabase in interface IDataLoaderService

getAvailableDataLoaderFactories

public java.util.List<java.lang.String> getAvailableDataLoaderFactories()

Specified by:

getAvailableDataLoaderFactories in interface IDataLoaderService

getDataLoaderFactories

protected java.util.Map<java.lang.String,IDataLoaderFactory> getDataLoaderFactories()

loadDataBatch

public java.util.List<IncomingBatch> loadDataBatch(java.lang.String batchData)

Specified by:

loadDataBatch in interface IDataLoaderService

loadDataFromPull

public RemoteNodeStatus loadDataFromPull(Node remote,
                                         java.lang.String queue)
                                  throws java.io.IOException

Connect to the remote node and pull data. The acknowledgment of commit/error status is sent separately after the data is processed.

Specified by:

loadDataFromPull in interface IDataLoaderService

Throws:

java.io.IOException

loadDataFromPull

public void loadDataFromPull(Node remote,
                             RemoteNodeStatus status)
                      throws java.io.IOException

Specified by:

loadDataFromPull in interface IDataLoaderService

Throws:

java.io.IOException

updateBatchToSendCount

protected void updateBatchToSendCount(Node remote,
                                      IIncomingTransport transport)

loadDataFromPush

public void loadDataFromPush(Node sourceNode,
                             java.io.InputStream in,
                             java.io.OutputStream out)
                      throws java.io.IOException

Load database from input stream and write acknowledgment to output stream. This is used for a "push" request with a response of an acknowledgment.

Specified by:

loadDataFromPush in interface IDataLoaderService

Throws:

java.io.IOException

loadDataFromPush

public void loadDataFromPush(Node sourceNode,
                             java.lang.String queue,
                             java.io.InputStream in,
                             java.io.OutputStream out)
                      throws java.io.IOException

Load database from input stream and write acknowledgment to output stream. This is used for a "push" request with a response of an acknowledgment.

Specified by:

loadDataFromPush in interface IDataLoaderService

Throws:

java.io.IOException

purgeLoadBatchesFromStaging

protected void purgeLoadBatchesFromStaging(java.util.List<IncomingBatch> batchList)

loadDataFromOfflineTransport

public java.util.List<IncomingBatch> loadDataFromOfflineTransport(Node remote,
                                                                  RemoteNodeStatus status,
                                                                  IIncomingTransport transport)
                                                           throws java.io.IOException

Specified by:

loadDataFromOfflineTransport in interface IDataLoaderService

Throws:

java.io.IOException

loadDataFromConfig

public void loadDataFromConfig(Node remote,
                               RemoteNodeStatus status,
                               boolean force)
                        throws java.io.IOException

Specified by:

loadDataFromConfig in interface IDataLoaderService

Throws:

java.io.IOException

loadDataFromTransport

protected java.util.List<IncomingBatch> loadDataFromTransport(ProcessInfo transferInfo,
                                                              Node sourceNode,
                                                              IIncomingTransport transport,
                                                              java.io.OutputStream out)
                                                       throws java.io.IOException

Load database from input stream and return a list of batch statuses. This is used for a pull request that responds with data, and the acknowledgment is sent later.

Throws:

java.io.IOException

logOrRethrow

protected void logOrRethrow(java.lang.Throwable ex)
                     throws java.io.IOException

Throws:

java.io.IOException

buildDataWriter

protected org.jumpmind.symmetric.io.data.IDataWriter buildDataWriter(ProcessInfo processInfo,
                                                                     java.lang.String sourceNodeId,
                                                                     java.lang.String channelId,
                                                                     long batchId,
                                                                     boolean isRetry)

getFactory

protected IDataLoaderFactory getFactory(java.lang.String channelId)

getConflictSettingsNodeGroupLinks

public java.util.List<DataLoaderService.ConflictNodeGroupLink> getConflictSettingsNodeGroupLinks()

Specified by:

getConflictSettingsNodeGroupLinks in interface IDataLoaderService

clearCache

public void clearCache()

Specified by:

clearCache in interface IDataLoaderService

getConflictSettingsNodeGroupLinks

public java.util.List<DataLoaderService.ConflictNodeGroupLink> getConflictSettingsNodeGroupLinks(NodeGroupLink link,
                                                                                                 boolean refreshCache)

Specified by:

getConflictSettingsNodeGroupLinks in interface IDataLoaderService

delete

public void delete(DataLoaderService.ConflictNodeGroupLink settings)

Specified by:

delete in interface IDataLoaderService

deleteAllConflicts

public void deleteAllConflicts()

Specified by:

deleteAllConflicts in interface IDataLoaderService

save

public void save(DataLoaderService.ConflictNodeGroupLink setting)

Specified by:

save in interface IDataLoaderService

getIncomingErrors

public java.util.List<IncomingError> getIncomingErrors(long batchId,
                                                       java.lang.String nodeId)

Specified by:

getIncomingErrors in interface IDataLoaderService

getCurrentIncomingError

public IncomingError getCurrentIncomingError(long batchId,
                                             java.lang.String nodeId)

Specified by:

getCurrentIncomingError in interface IDataLoaderService

insertIncomingError

public void insertIncomingError(IncomingError incomingError)

Specified by:

insertIncomingError in interface IDataLoaderService

insertIncomingError

public void insertIncomingError(org.jumpmind.db.sql.ISqlTransaction transaction,
                                IncomingError incomingError)

Specified by:

insertIncomingError in interface IDataLoaderService

updateIncomingError

public void updateIncomingError(IncomingError incomingError)

Specified by:

updateIncomingError in interface IDataLoaderService

setTransportManager

protected void setTransportManager(ITransportManager transportManager)

Used for unit tests

filterDataLoaderType

public static java.lang.String filterDataLoaderType(java.lang.String dataLoaderType)