SQL Data Generator, SimpleExpressions very slow

The simplest way to populate your database with test data.

SQL Data Generator, SimpleExpressions very slow

Postby Jeppe K. Bloch » Fri Feb 28, 2014 1:48 pm

My SimpleExpressions generator is extremly slow. It do not matter if its a complex expression or simply inserting a constant. Casting to any specific type do not affect speed either.

In my current table of some 15 columns i can using a regex generator for the specified column generate 200.000 rows in seconds.

Using a SimpleExpression for the column instead slows down the whole process to 20.000 rows in 5 min.

Using PythonScript generator is as fast as the regex.
Jeppe K. Bloch
 
Posts: 1
Joined: Fri Feb 28, 2014 12:44 pm

Postby Brian Donahue » Mon Mar 03, 2014 11:35 am

Thanks for pointing this out. I will let someone know.
I would imagine Regex is faster - it's got a lot less to do by not hosting the DLR. Possibly other Python scripts are faster if you bulk-generate the entire column and return an array rather than a single.
Brian Donahue
 
Posts: 6668
Joined: Mon Aug 23, 2004 10:48 am

Postby Brian Donahue » Mon Mar 03, 2014 3:05 pm

Can you send an example of your simple expression?
Brian Donahue
 
Posts: 6668
Joined: Mon Aug 23, 2004 10:48 am


Return to SQL Data Generator 3

Who is online

Users browsing this forum: No registered users and 0 guests