freememegenerator.org
robots.txt

Robots Exclusion Standard data for freememegenerator.org

Resource Scan

Scan Details

Site Domain freememegenerator.org
Base Domain freememegenerator.org
Scan Status Ok
Last Scan2024-06-15T22:47:45+00:00
Next Scan 2024-06-22T22:47:45+00:00

Last Scan

Scanned2024-06-15T22:47:45+00:00
URL https://freememegenerator.org/robots.txt
Redirect https://www.freememegenerator.org/robots.txt
Redirect Domain www.freememegenerator.org
Redirect Base freememegenerator.org
Domain IPs 104.21.92.234, 172.67.200.26, 2606:4700:3032::6815:5cea, 2606:4700:3033::ac43:c81a
Redirect IPs 104.21.92.234, 172.67.200.26, 2606:4700:3032::6815:5cea, 2606:4700:3033::ac43:c81a
Response IP 172.67.200.26
Found Yes
Hash db0ac8d74eca926f4f6ddb96929c72866557fe35e5a3b31190b789dde31a0ebd
SimHash e440dd817155

Groups

googlebot

Rule Path
Disallow

slurp

Rule Path
Disallow

msnbot

Rule Path
Disallow

googlebot-image

Rule Path
Disallow

yahoo-mmcrawler

Rule Path
Disallow

psbot

Rule Path
Disallow

*

Rule Path
Disallow

Comments

  • robots.txt gerado em