litfad.com
robots.txt

Robots Exclusion Standard data for litfad.com

Resource Scan

Scan Details

Site Domain litfad.com
Base Domain litfad.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-09-10T09:56:55+00:00
Next Scan 2025-11-09T09:56:55+00:00

Last Successful Scan

Scanned2024-10-23T09:22:52+00:00
URL https://litfad.com/robots.txt
Redirect https://www.litfad.com/robots.txt
Redirect Domain www.litfad.com
Redirect Base litfad.com
Domain IPs 104.26.0.146, 104.26.1.146, 172.67.70.63, 2606:4700:20::681a:192, 2606:4700:20::681a:92, 2606:4700:20::ac43:463f
Redirect IPs 104.26.0.146, 104.26.1.146, 172.67.70.63, 2606:4700:20::681a:192, 2606:4700:20::681a:92, 2606:4700:20::ac43:463f
Response IP 104.26.1.146
Found Yes
Hash c0b94ed77e82d07c41ac7f758c5115fcf29001ff7d47543b5c17fbb2cbaf9612
SimHash aa4c5054ebb2

Groups

*

Rule Path
Disallow /search?
Disallow *.html?vid=

Other Records

Field Value
sitemap https://www.litfad.com/sitemap.xml