papilo99.net
robots.txt

Robots Exclusion Standard data for papilo99.net

Resource Scan

Scan Details

Site Domain papilo99.net
Base Domain papilo99.net
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a server error.
Last Scan2025-04-09T15:16:09+00:00
Next Scan 2025-07-08T15:16:09+00:00

Last Successful Scan

Scanned2023-11-24T15:14:04+00:00
URL https://papilo99.net/robots.txt
Redirect https://papilo99jp.com/robots.txt
Redirect Domain papilo99jp.com
Redirect Base papilo99jp.com
Domain IPs 104.21.27.242, 172.67.169.215, 2606:4700:3035::6815:1bf2, 2606:4700:3036::ac43:a9d7
Redirect IPs 104.21.41.212, 172.67.193.153, 2606:4700:3031::6815:29d4, 2606:4700:3036::ac43:c199
Response IP 172.67.193.153
Found Yes
Hash e9f73c8305dfcf5044dc739472e9faef292c9b3e396497a0e2908c7d739c8f16
SimHash 6549c30557d7

Groups

googlebot

Rule Path
Disallow

googlebot-image

Rule Path
Disallow

googlebot-mobile

Rule Path
Disallow

slurp

Rule Path
Disallow

yahoo-mmcrawler

Rule Path
Disallow

yahoo-blogs/v3.9

Rule Path
Disallow

*

Rule Path
Disallow
Disallow /cgi-bin/

Other Records

Field Value
sitemap https://papilo99jp.com/sitemap.xml/

Warnings

  • 1 invalid line.