marshmallow-qa.com
robots.txt

Robots Exclusion Standard data for marshmallow-qa.com

Resource Scan

Scan Details

Site Domain marshmallow-qa.com
Base Domain marshmallow-qa.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-04-21T01:58:08+00:00
Next Scan 2024-07-20T01:58:08+00:00

Last Successful Scan

Scanned2022-12-26T19:44:20+00:00
URL https://marshmallow-qa.com/robots.txt
Domain IPs 104.21.61.251, 172.67.217.65, 2606:4700:3032::ac43:d941, 2606:4700:3037::6815:3dfb
Response IP 104.21.61.251
Found Yes
Hash 69baf0fb70600e7cb2a31180b201d90fc057a0e86ad76ed62a2093c50811d19d
SimHash a8901985ff74

Groups

*

Rule Path
Disallow /apt/

twitterbot

Rule Path
Allow /apt/

Comments

  • See http://www.robotstxt.org/robotstxt.html for documentation on how to use the robots.txt file