Page MenuHomeGitPull.it

scrape.sh
No OneTemporary

Authored By
Unknown
Size
318 B
Referenced Files
None
Subscribers
None

scrape.sh

#!/bin/sh
# A stupid script to generate the data/players.csv file
while read url; do
if [ "$url" ]; then
wget -O - "$url" | ./parse.php >> data/players.csv
sleep 5
fi
done < data/source.urls
# sort and unique
sort data/players.csv | uniq > data/players.csv.uniq
mv data/players.csv.uniq data/players.csv

File Metadata

Mime Type
text/x-shellscript
Expires
Wed, Nov 18, 20:00 (4 h, 46 m)
Storage Engine
blob
Storage Format
Raw Data
Storage Handle
2262972
Default Alt Text
scrape.sh (318 B)

Event Timeline