babafig.com
robots.txt

Robots Exclusion Standard data for babafig.com

Resource Scan

Scan Details

Site Domain babafig.com
Base Domain babafig.com
Scan Status Ok
Last Scan2024-06-27T10:57:57+00:00
Next Scan 2024-07-04T10:57:57+00:00

Last Scan

Scanned2024-06-27T10:57:57+00:00
URL https://babafig.com/robots.txt
Domain IPs 104.21.18.187, 172.67.183.33, 2606:4700:3032::ac43:b721, 2606:4700:3037::6815:12bb
Response IP 104.21.18.187
Found Yes
Hash 729dea7b41f8a263ce5c743379ecd3bc509fcdafe56273fe560fbbb184deb81e
SimHash 244976673c2b

Groups

*

Rule Path
Disallow /content/backups
Disallow /content/languages
Disallow /includes/libs
Disallow /install
Disallow /admincp
Disallow /modcp

googlebot
bingbot
yahoo slurp
baidu spider
yandex bot
duckduckbot
exalead
sogou spider
seznam bot
naver bot

Rule Path
Allow /blogs
Allow /people
Allow /pages
Allow /groups
Allow /market
Allow /jobs
Allow /forums
Allow /movies
Allow /games
Allow /events
Allow /*.jpg
Allow /*.png
Allow /*.webp
Allow /*.jpeg