Page Menu
Home
GitPull.it
Search
Configure Global Search
Log In
Files
F15160315
scrape.sh
No One
Temporary
Actions
Download File
Edit File
Delete File
View Transforms
Subscribe
Mute Notifications
Award Token
Authored By
Unknown
Size
318 B
Referenced Files
None
Subscribers
None
scrape.sh
View Options
#!/bin/sh
# A stupid script to generate the data/players.csv file
while
read
url
;
do
if
[
"
$url
"
]
;
then
wget
-O
-
"
$url
"
|
./parse.php
>>
data/players.csv
sleep
5
fi
done
<
data/source.urls
# sort and unique
sort
data/players.csv
|
uniq
>
data/players.csv.uniq
mv
data/players.csv.uniq
data/players.csv
File Metadata
Details
Attached
Mime Type
text/x-shellscript
Expires
Wed, Nov 18, 20:00 (4 h, 46 m)
Storage Engine
blob
Storage Format
Raw Data
Storage Handle
2262972
Default Alt Text
scrape.sh (318 B)
Attached To
Mode
R24 Wikimedia Valerio_Bozzolan_bot tasks
Attached
Detach File
Event Timeline