lolcgeneral.com
robots.txt

Robots Exclusion Standard data for lolcgeneral.com

Resource Scan

Scan Details

Site Domain lolcgeneral.com
Base Domain lolcgeneral.com
Scan Status Ok
Last Scan2025-12-10T21:15:24+00:00
Next Scan 2026-01-09T21:15:24+00:00

Last Scan

Scanned2025-12-10T21:15:24+00:00
URL https://lolcgeneral.com/robots.txt
Redirect https://www.lolcgeneral.com/robots.txt
Redirect Domain www.lolcgeneral.com
Redirect Base lolcgeneral.com
Domain IPs 104.21.83.2, 172.67.166.115, 2606:4700:3031::6815:5302, 2606:4700:3034::ac43:a673
Redirect IPs 104.21.83.2, 172.67.166.115, 2606:4700:3031::6815:5302, 2606:4700:3034::ac43:a673
Response IP 172.67.166.115
Found Yes
Hash 93071b03941ee7c1eb0ab028219a8860e4251283ecbf4b3c9126a0ed6dedbe5f
SimHash a84f8f94889b

Groups

*

Rule Path
Disallow /404.html
Disallow /messages.html
Disallow *.php
Disallow /reviews-form.html
Disallow /sitemap-org.xml
Disallow */cdn-cgi/*

Other Records

Field Value
sitemap https://www.lolcgeneral.com/sitemap.xml