iberofwd.mx
robots.txt

Robots Exclusion Standard data for iberofwd.mx

Resource Scan

Scan Details

Site Domain iberofwd.mx
Base Domain iberofwd.mx
Scan Status Ok
Last Scan2025-12-21T23:55:09+00:00
Next Scan 2026-01-20T23:55:09+00:00

Last Scan

Scanned2025-12-21T23:55:09+00:00
URL https://iberofwd.mx/robots.txt
Domain IPs 104.21.96.86, 172.67.175.134, 2606:4700:3031::ac43:af86, 2606:4700:3036::6815:6056
Response IP 104.21.96.86
Found Yes
Hash 13b9648a5c5f2315ec22f3641ecfc315e436c5080262986d787e87524df1c498
SimHash 4c047a30ee77

Groups

*

Rule Path
Disallow /search
Disallow /admin
Disallow /search?*
Disallow /search?search=
Disallow /*.pdf$
Disallow /?
Disallow /*?
Disallow /*?page=
Disallow /cgi-bin*
Allow /

gptbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://iberofwd.mx/sitemap.xml