Hi All,


I have started using MySQL 6.0.2 with Falcon on Linux
with Debian 4.
I have compiled the source code for 64 bit executable.
The system is an Intel 2 cpus 4 cores each, with 8 GB
of RAM.

I have started creating tables (without partitioning)
whit engine type Falcon. After having created
approximately 8,500 empty tables mysqld server was
still alive, you could connect with the mysql client,
but any command that you would type would freeze
(never come back).

I will try to re-run the same job, enabling
falcon_debug_mask and see if I can get more info and
repeat the problem.

Mariella



Below are shown the Falcon settings used:

+----------------------------------+-----------------+

| Variable_name | Value |
+----------------------------------+-----------------+
| falcon_checkpoint_schedule | 7 * * * * * |
| falcon_debug_mask | 0 |
| falcon_debug_server | OFF |

| falcon_disable_fsync | OFF |

| falcon_index_chill_threshold | 4 |

| falcon_initial_allocation | 1073741824 |

| falcon_max_transaction_backlog | 150 |

| falcon_page_cache_size | 4194304 |
| falcon_page_size | 4096 |
| falcon_record_chill_threshold | 5 |
| falcon_record_memory_max | 262144000 |

| falcon_record_scavenge_floor | 50 |

| falcon_record_scavenge_threshold | 67 |

| falcon_scavenge_schedule | 15,45 * * * * * |

| falcon_serial_log_buffers | 10 |

| falcon_serial_log_dir | |
| have_falcon | YES |
+----------------------------------+-----------------+






__________________________________________________ __________________________________
Need a vacation? Get great deals
to amazing places on Yahoo! Travel.
http://travel.yahoo.com/

I have re-run and job and I was able to repeat the
problem.
Find attached the mysql server error log with all the
tarces.


Could you please ?

Thanks,

Mariella



--- Mariella Petrini <mariellapetrini@yahoo.com>
wrote:

> Hi All,
>
>
> I have started using MySQL 6.0.2 with Falcon on
> Linux
> with Debian 4.
> I have compiled the source code for 64 bit
> executable.
> The system is an Intel 2 cpus 4 cores each, with 8
> GB
> of RAM.
>
> I have started creating tables (without
> partitioning)
> whit engine type Falcon. After having created
> approximately 8,500 empty tables mysqld server was
> still alive, you could connect with the mysql
> client,
> but any command that you would type would freeze
> (never come back).
>
> I will try to re-run the same job, enabling
> falcon_debug_mask and see if I can get more info and
> repeat the problem.
>
> Mariella
>
>
>
> Below are shown the Falcon settings used:
>
>
+----------------------------------+-----------------+
>
> | Variable_name | Value
> |
>
+----------------------------------+-----------------+
> | falcon_checkpoint_schedule | 7 * * * * *
> |
> | falcon_debug_mask | 0
> |
> | falcon_debug_server | OFF
> |
>
> | falcon_disable_fsync | OFF
> |
>
> | falcon_index_chill_threshold | 4
> |
>
> | falcon_initial_allocation | 1073741824
> |
>
> | falcon_max_transaction_backlog | 150
> |
>
> | falcon_page_cache_size | 4194304
> |
> | falcon_page_size | 4096
> |
> | falcon_record_chill_threshold | 5
> |
> | falcon_record_memory_max | 262144000
> |
>
> | falcon_record_scavenge_floor | 50
> |
>
> | falcon_record_scavenge_threshold | 67
> |
>
> | falcon_scavenge_schedule | 15,45 * * * * *
> |
>
> | falcon_serial_log_buffers | 10
> |
>
> | falcon_serial_log_dir |
> |
> | have_falcon | YES
> |
>
+----------------------------------+-----------------+
>
>
>
>
>
>
>
__________________________________________________ __________________________________
> Need a vacation? Get great deals
> to amazing places on Yahoo! Travel.
> http://travel.yahoo.com/
>
> --
> MySQL Internals Mailing List
> For list archives: http://lists.mysql.com/internals
> To unsubscribe:
>
http://lists.mysql.com/internals?uns...rini@yahoo.com
>
>


__________________________________________________ __________________________________
Shape Yahoo! in your own image. Join our Network Research Panel today! http://surveylink.yahoo.com/gmrs/yah...invite.asp?a=7

I never tried the falcon engine, but could it be that mysql is running
out of file descriptor ?

I think debian is limited to something around 8k per user by default.
Check your pam settings and your ulimit ... Database usually use a lot
of file handle and it's generally safe to increase it. Don't know if
falcon use file handle per table or not tough...

--
Mathieu Bruneau
aka ROunofF

===
GPG keys available @ http://rounoff.darktech.org

Mariella Petrini a écrit :
> I have re-run and job and I was able to repeat the
> problem.
> Find attached the mysql server error log with all the
> tarces.
>
>
> Could you please ?
>
> Thanks,
>
> Mariella
>
>
>
> --- Mariella Petrini <mariellapetrini@yahoo.com>
> wrote:
>
>> Hi All,
>>
>>
>> I have started using MySQL 6.0.2 with Falcon on
>> Linux
>> with Debian 4.
>> I have compiled the source code for 64 bit
>> executable.
>> The system is an Intel 2 cpus 4 cores each, with 8
>> GB
>> of RAM.
>>
>> I have started creating tables (without
>> partitioning)
>> whit engine type Falcon. After having created
>> approximately 8,500 empty tables mysqld server was
>> still alive, you could connect with the mysql
>> client,
>> but any command that you would type would freeze
>> (never come back).
>>
>> I will try to re-run the same job, enabling
>> falcon_debug_mask and see if I can get more info and
>> repeat the problem.
>>
>> Mariella
>>
>>
>>
>> Below are shown the Falcon settings used:
>>
>>
> +----------------------------------+-----------------+
>>
>> | Variable_name | Value
>> |
>>
> +----------------------------------+-----------------+
>> | falcon_checkpoint_schedule | 7 * * * * *
>> |
>> | falcon_debug_mask | 0
>> |
>> | falcon_debug_server | OFF
>> |
>>
>> | falcon_disable_fsync | OFF
>> |
>>
>> | falcon_index_chill_threshold | 4
>> |
>>
>> | falcon_initial_allocation | 1073741824
>> |
>>
>> | falcon_max_transaction_backlog | 150
>> |
>>
>> | falcon_page_cache_size | 4194304
>> |
>> | falcon_page_size | 4096
>> |
>> | falcon_record_chill_threshold | 5
>> |
>> | falcon_record_memory_max | 262144000
>> |
>>
>> | falcon_record_scavenge_floor | 50
>> |
>>
>> | falcon_record_scavenge_threshold | 67
>> |
>>
>> | falcon_scavenge_schedule | 15,45 * * * * *
>> |
>>
>> | falcon_serial_log_buffers | 10
>> |
>>
>> | falcon_serial_log_dir |
>> |
>> | have_falcon | YES
>> |
>>
> +----------------------------------+-----------------+
>>
>>
>>
>>
>>
>>
> __________________________________________________ __________________________________
>> Need a vacation? Get great deals
>> to amazing places on Yahoo! Travel.
>> http://travel.yahoo.com/
>>
>> --
>> MySQL Internals Mailing List
>> For list archives: http://lists.mysql.com/internals
>> To unsubscribe:
>>
> http://lists.mysql.com/internals?uns...rini@yahoo.com
>>
>
>
> __________________________________________________ __________________________________
> Shape Yahoo! in your own image. Join our Network Research Panel today! http://surveylink.yahoo.com/gmrs/yah...invite.asp?a=7
>
>
>
>
> ------------------------------------------------------------------------
>
>

If Debian is limited to create files over 8k, it can be the reason of the
problem.

Falcon seems not create data file for tables, but still create ".frm" files
for each tables.

--
Jaemyung Kim

2007/9/9, Mathieu Bruneau <mathieu.bruneau@argontechnologies.ca>:
>
> I never tried the falcon engine, but could it be that mysql is running
> out of file descriptor ?
>
> I think debian is limited to something around 8k per user by default.
> Check your pam settings and your ulimit ... Database usually use a lot
> of file handle and it's generally safe to increase it. Don't know if
> falcon use file handle per table or not tough...
>
> --
> Mathieu Bruneau
> aka ROunofF
>
> ===
> GPG keys available @ http://rounoff.darktech.org
>
> Mariella Petrini a écrit :
> > I have re-run and job and I was able to repeat the
> > problem.
> > Find attached the mysql server error log with all the
> > tarces.
> >
> >
> > Could you please ?
> >
> > Thanks,
> >
> > Mariella
> >
> >
> >
> > --- Mariella Petrini <mariellapetrini@yahoo.com>
> > wrote:
> >
> >> Hi All,
> >>
> >>
> >> I have started using MySQL 6.0.2 with Falcon on
> >> Linux
> >> with Debian 4.
> >> I have compiled the source code for 64 bit
> >> executable.
> >> The system is an Intel 2 cpus 4 cores each, with 8
> >> GB
> >> of RAM.
> >>
> >> I have started creating tables (without
> >> partitioning)
> >> whit engine type Falcon. After having created
> >> approximately 8,500 empty tables mysqld server was
> >> still alive, you could connect with the mysql
> >> client,
> >> but any command that you would type would freeze
> >> (never come back).
> >>
> >> I will try to re-run the same job, enabling
> >> falcon_debug_mask and see if I can get more info and
> >> repeat the problem.
> >>
> >> Mariella
> >>
> >>
> >>
> >> Below are shown the Falcon settings used:
> >>
> >>
> > +----------------------------------+-----------------+
> >>
> >> | Variable_name | Value
> >> |
> >>
> > +----------------------------------+-----------------+
> >> | falcon_checkpoint_schedule | 7 * * * * *
> >> |
> >> | falcon_debug_mask | 0
> >> |
> >> | falcon_debug_server | OFF
> >> |
> >>
> >> | falcon_disable_fsync | OFF
> >> |
> >>
> >> | falcon_index_chill_threshold | 4
> >> |
> >>
> >> | falcon_initial_allocation | 1073741824
> >> |
> >>
> >> | falcon_max_transaction_backlog | 150
> >> |
> >>
> >> | falcon_page_cache_size | 4194304
> >> |
> >> | falcon_page_size | 4096
> >> |
> >> | falcon_record_chill_threshold | 5
> >> |
> >> | falcon_record_memory_max | 262144000
> >> |
> >>
> >> | falcon_record_scavenge_floor | 50
> >> |
> >>
> >> | falcon_record_scavenge_threshold | 67
> >> |
> >>
> >> | falcon_scavenge_schedule | 15,45 * * * * *
> >> |
> >>
> >> | falcon_serial_log_buffers | 10
> >> |
> >>
> >> | falcon_serial_log_dir |
> >> |
> >> | have_falcon | YES
> >> |
> >>
> > +----------------------------------+-----------------+
> >>
> >>
> >>
> >>
> >>
> >>
> >
> __________________________________________________ __________________________________
> >> Need a vacation? Get great deals
> >> to amazing places on Yahoo! Travel.
> >> http://travel.yahoo.com/
> >>
> >> --
> >> MySQL Internals Mailing List
> >> For list archives: http://lists.mysql.com/internals
> >> To unsubscribe:
> >>
> > http://lists.mysql.com/internals?uns...rini@yahoo.com
> >>
> >
> >
> >
> __________________________________________________ __________________________________
> > Shape Yahoo! in your own image. Join our Network Research Panel
> today! http://surveylink.yahoo.com/gmrs/yah...invite.asp?a=7
> >
> >
> >
> >
> > ------------------------------------------------------------------------
> >
> >
>
>
> --
> MySQL Internals Mailing List
> For list archives: http://lists.mysql.com/internals
> To unsubscribe: http://lists.mysql.com/internals?unsub=jam02k@gmail.com
>
>

I don't think that is the problem.
I have been able to create over a 1,000,000 of tables with MySQL 5.1.21 and different storage engines with the same environment (I had already ulimit set).


Thanks,

Mariella


Mathieu Bruneau <mathieu.bruneau@argontechnologies.ca> wrote: I never tried the falcon engine, but could it be that mysql is running
out of file descriptor ?

I think debian is limited to something around 8k per user by default.
Check your pam settings and your ulimit ... Database usually use a lot
of file handle and it's generally safe to increase it. Don't know if
falcon use file handle per table or not tough...

--
Mathieu Bruneau
aka ROunofF

===
GPG keys available @ http://rounoff.darktech.org

Mariella Petrini a �crit :
> I have re-run and job and I was able to repeat the
> problem.
> Find attached the mysql server error log with all the
> tarces.
>
>
> Could you please ?
>
> Thanks,
>
> Mariella
>
>
>
> --- Mariella Petrini
> wrote:
>
>> Hi All,
>>
>>
>> I have started using MySQL 6.0.2 with Falcon on
>> Linux
>> with Debian 4.
>> I have compiled the source code for 64 bit
>> executable.
>> The system is an Intel 2 cpus 4 cores each, with 8
>> GB
>> of RAM.
>>
>> I have started creating tables (without
>> partitioning)
>> whit engine type Falcon. After having created
>> approximately 8,500 empty tables mysqld server was
>> still alive, you could connect with the mysql
>> client,
>> but any command that you would type would freeze
>> (never come back).
>>
>> I will try to re-run the same job, enabling
>> falcon_debug_mask and see if I can get more info and
>> repeat the problem.
>>
>> Mariella
>>
>>
>>
>> Below are shown the Falcon settings used:
>>
>>
> +----------------------------------+-----------------+
>>
>> | Variable_name | Value
>> |
>>
> +----------------------------------+-----------------+
>> | falcon_checkpoint_schedule | 7 * * * * *
>> |
>> | falcon_debug_mask | 0
>> |
>> | falcon_debug_server | OFF
>> |
>>
>> | falcon_disable_fsync | OFF
>> |
>>
>> | falcon_index_chill_threshold | 4
>> |
>>
>> | falcon_initial_allocation | 1073741824
>> |
>>
>> | falcon_max_transaction_backlog | 150
>> |
>>
>> | falcon_page_cache_size | 4194304
>> |
>> | falcon_page_size | 4096
>> |
>> | falcon_record_chill_threshold | 5
>> |
>> | falcon_record_memory_max | 262144000
>> |
>>
>> | falcon_record_scavenge_floor | 50
>> |
>>
>> | falcon_record_scavenge_threshold | 67
>> |
>>
>> | falcon_scavenge_schedule | 15,45 * * * * *
>> |
>>
>> | falcon_serial_log_buffers | 10
>> |
>>
>> | falcon_serial_log_dir |
>> |
>> | have_falcon | YES
>> |
>>
> +----------------------------------+-----------------+
>>
>>
>>
>>
>>
>>
> __________________________________________________ __________________________________
>> Need a vacation? Get great deals
>> to amazing places on Yahoo! Travel.
>> http://travel.yahoo.com/
>>
>> --
>> MySQL Internals Mailing List
>> For list archives: http://lists.mysql.com/internals
>> To unsubscribe:
>>
> http://lists.mysql.com/internals?uns...rini@yahoo.com
>>
>
>
> __________________________________________________ __________________________________
> Shape Yahoo! in your own image. Join our Network Research Panel today! http://surveylink.yahoo.com/gmrs/yah...invite.asp?a=7
>
>
>
>
> ------------------------------------------------------------------------
>
>




---------------------------------
Be a better Heartthrob. Get better relationship answers from someone who knows.
Yahoo! Answers - Check it out.

Mathieu Bruneau wrote:
> I never tried the falcon engine, but could it be that mysql is running
> out of file descriptor ?
>


That's less likely with Falcon than with engines that put each
table and index in its own file. By default, Falcon tables share
a single tablespace.


Regards,


Ann

Mariella Petrini wrote:
>
>
> ...MySQL 6.0.2 with Falcon on Linux with Debian 4.
> I have compiled the source code for 64 bit executable.
> The system is an Intel 2 cpus 4 cores each, with 8 GB
> of RAM.
>
> After having created
> approximately 8,500 empty tables mysqld server was
> still alive, you could connect with the mysql client,
> but any command that you would type would freeze
> (never come back).

It would be interesting to get a stack trace at that
point. We do have tests that create that many tables,
so the problem is going to take some thought.
>
> I will try to re-run the same job, enabling
> falcon_debug_mask and see if I can get more info and
> repeat the problem.

Sounds good - that can produce a LOT of output... so
be sure to redirect it to a file.

Best regards,


Ann

Ann W. Harrison, on 09/09/2007 01:59 PM said:
>
> That's less likely with Falcon than with engines that put each
> table and index in its own file. By default, Falcon tables share
> a single tablespace.
>

Forgive the probably very naïve question, but I am confused about
something; if I am understanding correctly, you are saying that in this
respect, Falcon stores tables much like InnoDB in that it uses a file
that holds multiple tables, is that correct? What is the performance
advantage in this, if any? Does each database get its own file, or is
it some sort of global thing?

Thanks,
Mike

--
Michael B. Trausch http://www.trausch.us/
Pidgin 2.1.1 and plugins for Ubuntu Feisty!
(And Thunderbird 2.0.0.6, too!) http://www.trausch.us/pidgin