infobref.com
robots.txt

Robots Exclusion Standard data for infobref.com

Resource Scan

Scan Details

Site Domain infobref.com
Base Domain infobref.com
Scan Status Ok
Last Scan2025-09-01T01:49:21+00:00
Next Scan 2025-10-01T01:49:21+00:00

Last Scan

Scanned2025-09-01T01:49:21+00:00
URL https://infobref.com/robots.txt
Domain IPs 104.21.23.151, 172.67.211.174, 2606:4700:3033::6815:1797, 2606:4700:3037::ac43:d3ae
Response IP 172.67.211.174
Found Yes
Hash 18e62c9f80b4137cc3a7f596668e810f2f0c2fa9e74a5315c4e01b2a1e249ee1
SimHash 49400880c513

Groups

*

Rule Path
Disallow /wp/wp-admin/
Allow /wp/wp-admin/admin-ajax.php

gptbot

Rule Path
Disallow /

*

Rule Path
Disallow

Other Records

Field Value
sitemap https://infobref.com/sitemap_index.xml

Comments

  • START YOAST BLOCK
  • ---------------------------
  • ---------------------------
  • END YOAST BLOCK