techgup.com
robots.txt
Robots Exclusion Standard data for techgup.com
Resource Scan
Scan Details
| Site Domain | techgup.com |
| Base Domain | techgup.com |
| Scan Status | Ok |
| Last Scan | 2024-10-29T08:17:17+00:00 |
| Next Scan | 2024-11-05T08:17:17+00:00 |
Last Scan
| Scanned | 2024-10-29T08:17:17+00:00 |
| URL | https://techgup.com/robots.txt |
| Domain IPs | 13.33.30.106, 13.33.30.108, 13.33.30.45, 13.33.30.53, 2600:9000:229f:1a00:4:76e2:ebc0:93a1, 2600:9000:229f:2000:4:76e2:ebc0:93a1, 2600:9000:229f:3800:4:76e2:ebc0:93a1, 2600:9000:229f:4800:4:76e2:ebc0:93a1, 2600:9000:229f:8200:4:76e2:ebc0:93a1, 2600:9000:229f:8e00:4:76e2:ebc0:93a1, 2600:9000:229f:c800:4:76e2:ebc0:93a1, 2600:9000:229f:ca00:4:76e2:ebc0:93a1 |
| Response IP | 13.33.30.45 |
| Found | Yes |
| Hash | 0b0ef82755639af388589a31e8120d72e38380fe8fa1846d3423b7a8ee5c0336 |
| SimHash | ca0eca52cdc3 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | /admin/* |
| Disallow | /search/* |
| Disallow | /search?* |
| Disallow | /xhr/* |
| Disallow | /preview/story-* |
| Disallow | /amp/preview/story-* |
| Disallow | /staging/* |
| Disallow | /alfoo |
| Disallow | /sildoo |
| Disallow | /dutas |
| Disallow | /metsmall |
| Disallow | /embed/* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://techgup.com/sitemap/sitemap-index.xml |
| sitemap | https://techgup.com/news-sitemap-daily.xml |
| sitemap | https://techgup.com/feeds.xml |
| sitemap | https://techgup.com/sitemap-daily.xml |
Comments