automationforum.in
robots.txt
Robots Exclusion Standard data for automationforum.in
Resource Scan
Scan Details
Site Domain | automationforum.in |
Base Domain | automationforum.in |
Scan Status | Ok |
Last Scan | 2024-11-13T05:54:56+00:00 |
Next Scan | 2024-11-20T05:54:56+00:00 |
Last Scan
Scanned | 2024-11-13T05:54:56+00:00 |
URL | https://automationforum.in/robots.txt |
Redirect | https://forumautomation.com/robots.txt |
Redirect Domain | forumautomation.com |
Redirect Base | forumautomation.com |
Domain IPs | 104.21.3.130, 172.67.130.184, 2606:4700:3037::6815:382, 2606:4700:3037::ac43:82b8 |
Redirect IPs | 104.21.41.46, 172.67.159.246, 2606:4700:3030::6815:292e, 2606:4700:3036::ac43:9ff6 |
Response IP | 172.67.159.246 |
Found | Yes |
Hash | dde0dae7d4d4d8b65ef282fb03cfc489916e1ae4b5343f80563cba39a44676ed |
SimHash | a9911d8577f2 |
Groups
*
Rule | Path |
---|---|
Disallow | /admin/ |
Disallow | /auth/ |
Disallow | /assets/browser-update*.js |
Disallow | /email/ |
Disallow | /session |
Disallow | /user-api-key |
Disallow | /*?api_key* |
Disallow | /*?*api_key* |
Disallow | /badges |
Disallow | /u/ |
Disallow | /my |
Disallow | /search |
Disallow | /tag/*/l |
Disallow | /g |
Disallow | /t/*/*.rss |
Disallow | /c/*.rss |
Other Records
Field | Value |
---|---|
sitemap | https://forumautomation.com/sitemap.xml |
Comments