Difference between revisions of "MySQL Import Progress"
(Created page with "==Overview== Needed a progress indicator for an excessively long MySQL import. Created this down and dirty solution to give a very buggy inaccurate look at the progress. Expe...") |
|||
| (2 intermediate revisions by one other user not shown) | |||
| Line 1: | Line 1: | ||
| + | [[Category:Misc]] | ||
==Overview== | ==Overview== | ||
| Line 23: | Line 24: | ||
<code>[bash,n] | <code>[bash,n] | ||
#!/bin/bash | #!/bin/bash | ||
| − | currentcommand=` | + | currentcommand=`mysql --batch -e 'show processlist' | grep INSERT | head -1` |
currenttable=`echo $currentcommand | cut -d '\`' -f2` | currenttable=`echo $currentcommand | cut -d '\`' -f2` | ||
currentrecord=`echo $currentcommand | cut -d "(" -f2 | cut -d "," -f1` | currentrecord=`echo $currentcommand | cut -d "(" -f2 | cut -d "," -f1` | ||
| − | recordcount=`cat tablecounts.txt | grep "$currenttable," | cut -d "," -f2` | + | recordcount=`cat tablecounts.txt | grep "^$currenttable," | cut -d "," -f2` |
currentpercent=`echo $currentrecord $recordcount | awk '{print $1 / $2*100}'` | currentpercent=`echo $currentrecord $recordcount | awk '{print $1 / $2*100}'` | ||
| − | echo "$currenttable $currentrecord / $recordcount ($currentpercent)" | + | |
| + | #if [$currenttable -eq ""] | ||
| + | #then | ||
| + | # echo "no table being imported" | ||
| + | #else | ||
| + | echo "$currenttable $currentrecord / $recordcount ($currentpercent)" | ||
| + | #fi | ||
</code> | </code> | ||
| − | |||
==What to change== | ==What to change== | ||
Really need a better solution in the future. But this works for what we needed at the time. | Really need a better solution in the future. But this works for what we needed at the time. | ||
Latest revision as of 17:43, 17 February 2012
Contents
Overview
Needed a progress indicator for an excessively long MySQL import.
Created this down and dirty solution to give a very buggy inaccurate look at the progress.
Expect lots of errors as I have no error checking in here.
Its accurate at least once per table.
Step 1
Populate table counts
ID will need to be changed for what ever their autoinc field is. Will not work with non numeric values.
[bash,n]
for i in $(mysql <DATABASE> --batch -e 'show tables;' | grep -v "Tables_in"); do lastrecord=`mysql <DATABASE> --batch -e 'select id from '$i' order by id desc limit 1'|grep -v id`; echo "$i,$lastrecord" >> tablecounts.txt; done
Step 2
Run code and watch the bugs fly
[bash,n]
- !/bin/bash
currentcommand=`mysql --batch -e 'show processlist' | grep INSERT | head -1` currenttable=`echo $currentcommand | cut -d '\`' -f2` currentrecord=`echo $currentcommand | cut -d "(" -f2 | cut -d "," -f1`
recordcount=`cat tablecounts.txt | grep "^$currenttable," | cut -d "," -f2`
currentpercent=`echo $currentrecord $recordcount | awk '{print $1 / $2*100}'`
- if [$currenttable -eq ""]
- then
- echo "no table being imported"
- else
echo "$currenttable $currentrecord / $recordcount ($currentpercent)"
- fi
What to change
Really need a better solution in the future. But this works for what we needed at the time.
