offr.io
robots.txt

Robots Exclusion Standard data for offr.io

Resource Scan

Scan Details

Site Domain offr.io
Base Domain offr.io
Scan Status Ok
Last Scan4/21/2025, 11:30:27 AM
Next Scan 5/21/2025, 11:30:27 AM

Last Scan

Scanned4/21/2025, 11:30:27 AM
URL https://offr.io/robots.txt
Domain IPs 34.242.169.54, 34.251.26.109, 63.32.255.204
Response IP 63.32.255.204
Found Yes
Hash f881d6767e66c30787405d946c9fa1bb1075434f64c91104351116a9b8b4d299
SimHash 4b058a09d090

Groups

*

Rule Path
Allow /

blexbot

Rule Path
Disallow /

omniexplorer_bot

Rule Path
Disallow /

propbot

Rule Path
Disallow /

oodlebot

Rule Path
Disallow /

globrixbot

Rule Path
Disallow /

properazzibot

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

adsbot

Rule Path
Disallow /

webreaper

Rule Path
Disallow /

jooblebot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://offr.io/offr-sitemap.xml