in reply to Fetch Mysql huge database
getting rid of duplicates too:
I've never used mysql, but in other RDBMS systems I would check that enough memory has been assigned to buffer cache, sort area, hash sort area, etc. And by "enough", I mean "lots".select username from table where username != '' and username not like 'deleted%' and username not in (select username from other_table) group by username having count(*) > 1;
Joining two 34M rows on a decent enough server shouldn't take long. Nested iterations over 2 large tables does take a long time.
Having indexes on username on both tables would help a lot too
rdfield
|
---|
Replies are listed 'Best First'. | |
---|---|
Re^2: Fetch Mysql huge database
by sundialsvc4 (Abbot) on Sep 29, 2011 at 17:32 UTC | |
by aaron_baugher (Curate) on Sep 29, 2011 at 20:37 UTC |
In Section
Seekers of Perl Wisdom