aubtu.biz
robots.txt
Robots Exclusion Standard data for aubtu.biz
Resource Scan
Scan Details
| Site Domain | aubtu.biz |
| Base Domain | aubtu.biz |
| Scan Status | Ok |
| Last Scan | 2024-09-23T22:15:57+00:00 |
| Next Scan | 2024-09-30T22:15:57+00:00 |
Last Scan
| Scanned | 2024-09-23T22:15:57+00:00 |
| URL | https://aubtu.biz/robots.txt |
| Domain IPs | 104.26.12.214, 104.26.13.214, 172.67.70.141, 2606:4700:20::681a:cd6, 2606:4700:20::681a:dd6, 2606:4700:20::ac43:468d |
| Response IP | 104.26.13.214 |
| Found | Yes |
| Hash | ec5a16778231ad069e5c604b13b69a18538567cc525b9108dc94e357ae7bcc07 |
| SimHash | a9091cc0e391 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /admin/ |
| Disallow | /search?keyword= |
| Disallow | /static/fonts/ |
| Disallow | /pt/wp-content/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://aubtu.biz/sitemap-news1.xml |
| sitemap | https://aubtu.biz/sitemap.xml |
| sitemap | https://dailyhighlight.com/sitemap.xml |