allcounting.com
robots.txt
Robots Exclusion Standard data for allcounting.com
Resource Scan
Scan Details
Site Domain | allcounting.com |
Base Domain | allcounting.com |
Scan Status | Ok |
Last Scan | 2024-11-12T11:20:46+00:00 |
Next Scan | 2024-11-19T11:20:46+00:00 |
Last Scan
Scanned | 2024-11-12T11:20:46+00:00 |
URL | https://allcounting.com/robots.txt |
Domain IPs | 194.28.50.167 |
Response IP | 194.28.50.167 |
Found | Yes |
Hash | d64054d8233167c7b2ab6fa9a2482c02578dd1427785064f72a333c30ef2fcd1 |
SimHash | e98d41816b32 |
Groups
*
Rule | Path |
---|---|
Disallow | /forum/auth/cas |
Disallow | /forum/auth/facebook/callback |
Disallow | /forum/auth/twitter/callback |
Disallow | /forum/auth/google/callback |
Disallow | /forum/auth/yahoo/callback |
Disallow | /forum/auth/github/callback |
Disallow | /forum/auth/cas/callback |
Disallow | /forum/assets/browser-update*.js |
Disallow | /forum/users/ |
Disallow | /forum/badges/ |
Disallow | /forum/search |
Disallow | /forum/search/ |
Other Records
Field | Value |
---|---|
sitemap | https://allcounting.com/sitemaps/en/sitemap1.xml.gz |