Difference between revisions of "MySQL Import Progress"
(→Step 2) |
(→Step 2) |
||
| Line 23: | Line 23: | ||
<code>[bash,n] | <code>[bash,n] | ||
#!/bin/bash | #!/bin/bash | ||
| − | currentcommand=` | + | currentcommand=`mysql --batch -e 'show processlist' | grep INSERT | head -1` |
currenttable=`echo $currentcommand | cut -d '\`' -f2` | currenttable=`echo $currentcommand | cut -d '\`' -f2` | ||
currentrecord=`echo $currentcommand | cut -d "(" -f2 | cut -d "," -f1` | currentrecord=`echo $currentcommand | cut -d "(" -f2 | cut -d "," -f1` | ||
| − | recordcount=`cat tablecounts.txt | grep "$currenttable," | cut -d "," -f2` | + | recordcount=`cat tablecounts.txt | grep "^$currenttable," | cut -d "," -f2` |
currentpercent=`echo $currentrecord $recordcount | awk '{print $1 / $2*100}'` | currentpercent=`echo $currentrecord $recordcount | awk '{print $1 / $2*100}'` | ||
| − | echo "$currenttable $currentrecord / $recordcount ($currentpercent)" | + | |
| + | #if [$currenttable -eq ""] | ||
| + | #then | ||
| + | # echo "no table being imported" | ||
| + | #else | ||
| + | echo "$currenttable $currentrecord / $recordcount ($currentpercent)" | ||
| + | #fi | ||
</code> | </code> | ||
Revision as of 19:51, 4 May 2011
Contents
Overview
Needed a progress indicator for an excessively long MySQL import.
Created this down and dirty solution to give a very buggy inaccurate look at the progress.
Expect lots of errors as I have no error checking in here.
Its accurate at least once per table.
Step 1
Populate table counts
ID will need to be changed for what ever their autoinc field is. Will not work with non numeric values.
[bash,n]
for i in $(mysql <DATABASE> --batch -e 'show tables;' | grep -v "Tables_in"); do lastrecord=`mysql <DATABASE> --batch -e 'select id from '$i' order by id desc limit 1'|grep -v id`; echo "$i,$lastrecord" >> tablecounts.txt; done
Step 2
Run code and watch the bugs fly
[bash,n]
- !/bin/bash
currentcommand=`mysql --batch -e 'show processlist' | grep INSERT | head -1` currenttable=`echo $currentcommand | cut -d '\`' -f2` currentrecord=`echo $currentcommand | cut -d "(" -f2 | cut -d "," -f1`
recordcount=`cat tablecounts.txt | grep "^$currenttable," | cut -d "," -f2`
currentpercent=`echo $currentrecord $recordcount | awk '{print $1 / $2*100}'`
- if [$currenttable -eq ""]
- then
- echo "no table being imported"
- else
echo "$currenttable $currentrecord / $recordcount ($currentpercent)"
- fi
What to change
Really need a better solution in the future. But this works for what we needed at the time.
