Log In Sign Up

qiita.com
robots.txt

Robots Exclusion Standard data for qiita.com

Resource Scan

Scan Details

Site Domain qiita.com
Base Domain qiita.com
Scan Status Ok
Last Scan2024-11-08T11:17:06+00:00
Next Scan 2024-11-15T11:17:06+00:00

Last Scan

Scanned2024-11-08T11:17:06+00:00
URL https://qiita.com/robots.txt
Domain IPs 108.156.133.21, 108.156.133.49, 108.156.133.8, 108.156.133.94, 2600:9000:2755:2e00:8:e1de:4d80:93a1, 2600:9000:2755:400:8:e1de:4d80:93a1, 2600:9000:2755:4c00:8:e1de:4d80:93a1, 2600:9000:2755:5800:8:e1de:4d80:93a1, 2600:9000:2755:5c00:8:e1de:4d80:93a1, 2600:9000:2755:6600:8:e1de:4d80:93a1, 2600:9000:2755:9e00:8:e1de:4d80:93a1, 2600:9000:2755:b800:8:e1de:4d80:93a1
Response IP 108.156.133.49
Found Yes
Hash b3253993928db537788f95d56914bb262a34233d6427c3ebe853fea69e5ca6c8
SimHash 88542b457f62

Groups

*

Rule Path
Disallow /*/edit$
Disallow /api/*
Disallow /graphql$
Disallow /policies/td-optout$
Disallow /search
Disallow *.md
Disallow */items/*/revisions
Disallow */private/*/revisions
Allow /api/*/docs$
Back to top

Other Records

Field Value
sitemap https://cdn.qiita.com/sitemap-https/sitemap.xml.gz
Back to top

Comments

  • See http://www.robotstxt.org/wc/norobots.html for documentation on how to use the robots.txt file
Back to top