Log In Sign Up

fj32pic.com
robots.txt

Robots Exclusion Standard data for fj32pic.com

Resource Scan

Scan Details

Site Domain fj32pic.com
Base Domain fj32pic.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan4/1/2025, 3:18:10 PM
Next Scan 6/30/2025, 3:18:10 PM

Last Successful Scan

Scanned11/10/2024, 3:09:36 PM
URL https://fj32pic.com/robots.txt
Domain IPs 104.21.22.98, 172.67.204.42
Response IP 104.21.22.98
Found Yes
Hash 357a82b4913c99c6ce1d952b83063d5386261a66d9aea78f031dbaf760da9df8
SimHash 281657835546

Groups

baiduspider

Rule Path
Disallow /

sosospider

Rule Path
Disallow /

sogou spider

Rule Path
Disallow /

yodaobot

Rule Path
Disallow /

googlebot

Rule Path
Disallow /

bingbot

Rule Path
Disallow /

slurp

Rule Path
Disallow /

teoma

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

twiceler

Rule Path
Disallow /

msnbot

Rule Path
Disallow /

scrubby

Rule Path
Disallow /

robozilla

Rule Path
Disallow /

gigabot

Rule Path
Disallow /

googlebot-image

Rule Path
Disallow /

googlebot-mobile

Rule Path
Disallow /

yahoo-mmcrawler

Rule Path
Disallow /

yahoo-blogs/v3.9

Rule Path
Disallow /

psbot

Rule Path
Disallow /
Disallow /public/
Disallow /sql/
Disallow /config/
Disallow /app/
Disallow /database/
Disallow /resources/
Disallow /routes/
Disallow /vendor
Back to top