appliedtechreview.com
robots.txt
Robots Exclusion Standard data for appliedtechreview.com
Resource Scan
Scan Details
| Site Domain | appliedtechreview.com |
| Base Domain | appliedtechreview.com |
| Scan Status | Ok |
| Last Scan | 2025-10-27T23:13:49+00:00 |
| Next Scan | 2025-11-03T23:13:49+00:00 |
Last Scan
| Scanned | 2025-10-27T23:13:49+00:00 |
| URL | https://appliedtechreview.com/robots.txt |
| Redirect | https://www.appliedtechnologyreview.com/robots.txt |
| Redirect Domain | www.appliedtechnologyreview.com |
| Redirect Base | appliedtechnologyreview.com |
| Domain IPs | 44.242.102.158 |
| Redirect IPs | 44.242.102.158 |
| Response IP | 44.242.102.158 |
| Found | Yes |
| Hash | 0806393e953de60dffb854395c7d4891c30bdbcbbbec56d14ab71adf36dfdfc2 |
| SimHash | 3905de92c691 |
Groups
*
| Rule | Path | Comment |
|---|---|---|
| Disallow | / | Disallow all bots by default |
| Disallow | /scripts/ | - |
| Disallow | /*.php$ | - |
| Disallow | /zlib/ | - |
| Disallow | /lib/ | - |
| Disallow | /utils/ | - |
| Disallow | /magazine/ | - |
| Disallow | /admin/ | - |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.appliedtechnologyreview.com/appliedtechnology_news_sitemap.xml |
| sitemap | https://www.appliedtechnologyreview.com/appliedtechnologyreviewnewnews_sitemap.xml |
| sitemap | https://www.appliedtechnologyreview.com/vertical_sitemap.xml |
| sitemap | https://www.appliedtechnologyreview.com/all_in_one_sitemap_main.xml |
| sitemap | https://www.appliedtechnologyreview.com/rankingxml_sitemap_new.xml |
| sitemap | https://www.appliedtechnologyreview.com/appliedtechnology_vendor_sitemap_new.xml |
| sitemap | https://www.appliedtechnologyreview.com/contributors_sitemap.xml |
Comments