spankinglibrary.com
robots.txt

Robots Exclusion Standard data for spankinglibrary.com

Resource Scan

Scan Details

Site Domain spankinglibrary.com
Base Domain spankinglibrary.com
Scan Status Ok
Last Scan2024-09-11T10:31:00+00:00
Next Scan 2024-10-11T10:31:00+00:00

Last Scan

Scanned2024-09-11T10:31:00+00:00
URL https://spankinglibrary.com/robots.txt
Domain IPs 45.32.3.115
Response IP 45.32.3.115
Found Yes
Hash 75537428f78f485d44e699a6c9aa6959d2181fe3f6d1ca56d9e21a9e6684004c
SimHash c8344da26a83

Groups

*

Rule Path
Disallow

Other Records

Field Value
crawl-delay 3600

googlebot

Rule Path
Disallow /clipdata/
Disallow /storedata/

baiduspider
yandexbot
baiduspider
baiduspider-image
baiduspider-video
yandexbot
yandexmedia
yandeximages
yandexblogs
ahrefsbot
moget
ichiro
naverbot
yeti
youdaobot
semrushbot
dotbot

Rule Path
Disallow /