slant.co
robots.txt
Robots Exclusion Standard data for slant.co
Resource Scan
Scan Details
Site Domain | slant.co |
Base Domain | slant.co |
Scan Status | Ok |
Last Scan | 2024-06-04T12:46:10+00:00 |
Next Scan | 2024-06-11T12:46:10+00:00 |
Last Scan
Scanned | 2024-06-04T12:46:10+00:00 |
URL | https://slant.co/robots.txt |
Redirect | https://www.slant.co/robots.txt |
Redirect Domain | www.slant.co |
Redirect Base | slant.co |
Domain IPs | 104.21.71.85, 172.67.143.252, 2606:4700:3031::ac43:8ffc, 2606:4700:3034::6815:4755 |
Redirect IPs | 104.21.71.85, 172.67.143.252, 2606:4700:3031::ac43:8ffc, 2606:4700:3034::6815:4755 |
Response IP | 172.67.143.252 |
Found | Yes |
Hash | 5e59ea0ec2c334c938a685843fc28a654db7cdc7e0edaf174e5ad2ff57b9c1d8 |
SimHash | 485ef53597d7 |
Groups
*
Rule | Path |
---|---|
Disallow | /*?*filter=improve |
Disallow | /activity |
Disallow | /auth |
Disallow | /cdn-cgi |
Disallow | /improve/versus/* |
Disallow | /improve/options/* |
Disallow | /loading |
Disallow | /login |
Disallow | /logout |
Disallow | /maintenance |
Disallow | /metrics |
Disallow | /mgmt |
Disallow | /search |
Disallow | /stats |
Disallow | /tags/*?*filter_tags= |
Disallow | /test |
Disallow | /topics/*/activity |
Disallow | /topics/*/comments |
Disallow | /topics/*/history |
Disallow | /topics/*/pending |
Disallow | /topics/*/votes |
Disallow | /topics/create |
Disallow | /userInfo |
Allow | / |
Allow | /activity*?*format=json |
Allow | /search*?*format=json |
Allow | /topics/*/activity*?*format=json |
Allow | /topics/*/comments*?*format=json |
Allow | /topics/*/history*?*format=json |
Allow | /topics/*/pending*?*format=json |
Allow | /users/*/*?* |
Other Records
Field | Value |
---|---|
sitemap | https://www.slant.co/sitemap-ai.xml |
sitemap | https://www.slant.co/sitemap.xml |