bff.fm
robots.txt

Robots Exclusion Standard data for bff.fm

Resource Scan

Scan Details

Site Domain bff.fm
Base Domain bff.fm
Scan Status Ok
Last Scan2024-11-08T13:59:54+00:00
Next Scan 2024-12-08T13:59:54+00:00

Last Scan

Scanned2024-11-08T13:59:54+00:00
URL https://bff.fm/robots.txt
Domain IPs 151.101.130.217, 151.101.194.217, 151.101.2.217, 151.101.66.217
Response IP 151.101.66.217
Found Yes
Hash 799b91b0dea6cb6e2c8d954c07ede27d5d9995ab020a3f4d3c59e31f76ae6bd7
SimHash 291d1c30e391

Groups

*

Rule Path
Disallow /tmp/
Disallow /admin/

Other Records

Field Value
crawl-delay 5

semrushbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /