webextrema.com
robots.txt

Robots Exclusion Standard data for webextrema.com

Resource Scan

Scan Details

Site Domain webextrema.com
Base Domain webextrema.com
Scan Status Ok
Last Scan2025-08-28T15:39:33+00:00
Next Scan 2025-09-27T15:39:33+00:00

Last Scan

Scanned2025-08-28T15:39:33+00:00
URL https://webextrema.com/robots.txt
Domain IPs 104.21.37.231, 172.67.214.174, 2606:4700:3032::6815:25e7, 2606:4700:3034::ac43:d6ae
Response IP 172.67.214.174
Found Yes
Hash ddf696957f9f0f18d6ec90160c6f3703d73878a08d46bce28d4c5407defeade5
SimHash 6109c2409fd3

Groups

*

Rule Path
Disallow
Disallow /cgi-bin/

Other Records

Field Value
sitemap https://www.webextrema.com/sitemap.xml

Warnings

  • 1 invalid line.