Stephan Köppen

It has been a while but I think this might be very useful information and something Microsoft should work on (yes, it has been addressed).

Anyway – back in time when I created the Database for our production system i wasn’t really thinking about the size it is going to have in the near future and time went by without any problems. But at one point DWLoader gave us a error message which I couldn’t really interpret. Unfortunately I didn’t happen for all loading processes but only for some. Of course not being able to write to the production system was a huge a problem so everything possible was done to figure out where the problem was.

Below you find the actually dwloader statements with the row information (partially) and the error message.

dwloader.exe -U USER -P PASS -r „\r\n“ -fh 2 -t 0x03 -rt value -rv 0 -e UTF8 -T [Test].[dbo].[TABLE] -i „load.csv“ -R „reject.tmp“ -E -M fastappend -m
[2014-02-27 11:49:31] Warning – Multiple transactions setting is set to true..
[2014-02-27 11:49:31] Starting Load
[2014-02-27 11:49:31] Load has started
[2014-02-27 11:49:31] Status: Running, Run Id: 61194 – Total Rows Processed: 0, Total Rows Rejected: 0
[2014-02-27 11:49:33] Status: Running, Run Id: 61194 – Total Rows Processed: 80736, Total Rows Rejected: 0
[2014-02-27 11:49:33] Status: Running, Run Id: 61194 – Total Rows Processed: 171564, Total Rows Rejected: 0
[2014-02-27 11:49:33] Status: Running, Run Id: 61194 – Total Rows Processed: 252300, Total Rows Rejected: 0
[2014-02-27 11:49:33] Status: Running, Run Id: 61194 – Total Rows Processed: 333036, Total Rows Rejected: 0
[2014-02-27 11:49:33] Status: Running, Run Id: 61194 – Total Rows Processed: 413772, Total Rows Rejected: 0
[2014-02-27 11:49:33] Status: Running, Run Id: 61194 – Total Rows Processed: 494508, Total Rows Rejected: 0
[2014-02-27 11:49:33] Status: Running, Run Id: 61194 – Total Rows Processed: 565152, Total Rows Rejected: 0
[2014-02-27 11:49:33] Status: Running, Run Id: 61194 – Total Rows Processed: 635796, Total Rows Rejected: 0
[2014-02-27 11:49:37] Status: Running, Run Id: 61194 – Total Rows Processed: 857820, Total Rows Rejected: 0
[2014-02-27 11:49:37] Status: Running, Run Id: 61194 – Total Rows Processed: 1069752, Total Rows Rejected: 0
[2014-02-27 11:49:37] Status: Running, Run Id: 61194 – Total Rows Processed: 1301868, Total Rows Rejected: 0
[2014-02-27 11:49:37] Status: Running, Run Id: 61194 – Total Rows Processed: 1513800, Total Rows Rejected: 0
[2014-02-27 11:49:37] Status: Running, Run Id: 61194 – Total Rows Processed: 1735824, Total Rows Rejected: 0
[2014-02-27 11:49:37] Status: Running, Run Id: 61194 – Total Rows Processed: 1947756, Total Rows Rejected: 0
[2014-02-27 11:49:37] Status: Running, Run Id: 61194 – Total Rows Processed: 2159688, Total Rows Rejected: 0
[2014-02-27 11:49:37] Status: Running, Run Id: 61194 – Total Rows Processed: 2391804, Total Rows Rejected: 0
[2014-02-27 11:49:43] Status: Running, Run Id: 61194 – Total Rows Processed: 2805576, Total Rows Rejected: 0
[2014-02-27 11:49:43] Status: Running, Run Id: 61194 – Total Rows Processed: 3209256, Total Rows Rejected: 0



[2014-02-27 11:50:05] Status: Running, Run Id: 61194 – Total Rows Processed: 21828996, Total Rows Rejected: 0
[2014-02-27 11:50:05] Status: Running, Run Id: 61194 – Total Rows Processed: 21909732, Total Rows Rejected: 0
[2014-02-27 11:50:05] Status: Running, Run Id: 61194 – Total Rows Processed: 21990468, Total Rows Rejected: 0
[2014-02-27 11:50:05] Status: Running, Run Id: 61194 – Total Rows Processed: 22071204, Total Rows Rejected: 0
[2014-02-27 11:50:05] Status: Running, Run Id: 61194 – Total Rows Processed: 22162032, Total Rows Rejected: 0
[2014-02-27 11:50:05] Status: Aborted, Run Id: 61194 – Error Code: 110802 – Message: An internal DMS error occurred that caused this operation to fail
. Details: Exception: Microsoft.SqlServer.DataWarehouse.DataMovement.Workers.DmsSqlNativeException, Message: SqlNativeBufferBufferBulkCopy.WriteToServ
er, error in OdbcWriteBuffer: SqlState: , NativeError: 0, ‚Error calling: bcp_batch(pConn->GetHdbc()) | SQL Error Info: SrvrMsgState: 0, SrvrSeverity:
0, | Error calling: pBcpConn->WriteBuffer(pBuffer, bufferOffset, bufferLength, pRowsWritten) | state: FFFF, number: 1157368, active connections: 8‘,
Connection String: Driver={SQL Server Native Client 10.0};APP=DmsNativeWriter:PDWT1-CMP02\sqldwdms (5260) – ODBC;Trusted_Connection=yes;AutoTranslate
=no;Server=PDWT1-SQLCMP02.PDWT1.dwpu.local,1502
[2014-02-27 11:50:05] Multiple Transaction support is ON. There might be inconsistencies with the data.
[2014-02-27 11:50:06] Load has Failed

 

To me the actually problem was not really visible and it took quite a bit of effort to figure out where the issue is, but after analyzing several log files I found something really interesting.

Error: 1101, Severity: 17, State: 12.
Could not allocate a new page for database ‚DB_fc977c0ed10d43ffab762d9a17230c21‘ because of insufficient disk space in filegroup ‚DIST_C‘. Create the necessary space by dropping objects in the filegroup, adding additional files to the filegroup, or setting autogrowth on for existing files in the filegroup

After changing the size and setting autogrow to one the problem was solved. Unfortunately the error message is not really useful and a lot of digging had to be done. I hope to see this changed at some point.