my.pencilapp.com
robots.txt

Robots Exclusion Standard data for my.pencilapp.com

Resource Scan

Scan Details

Site Domain my.pencilapp.com
Base Domain pencilapp.com
Scan Status Ok
Last Scan2024-11-17T13:47:59+00:00
Next Scan 2024-12-01T13:47:59+00:00

Last Scan

Scanned2024-11-17T13:47:59+00:00
URL https://my.pencilapp.com/robots.txt
Domain IPs 151.101.1.195, 151.101.65.195
Response IP 151.101.1.195
Found Yes
Hash 142e9cce3e5ffbad05d2b8ac66b23858324e0a1dddf716b6d523541800717360
SimHash 8e00cb00a731

Groups

*

Rule Path
Allow /
Disallow /spaces/*

Other Records

Field Value
sitemap https://my.pencilapp.com/sitemap-static.xml.gz
sitemap https://my.pencilapp.com/sitemap-index.xml.gz

Comments

  • Allow all crawlers