boldsky.com
robots.txt
Robots Exclusion Standard data for boldsky.com
Resource Scan
Scan Details
Site Domain | boldsky.com |
Base Domain | boldsky.com |
Scan Status | Ok |
Last Scan | 2024-09-24T06:07:36+00:00 |
Next Scan | 2024-10-01T06:07:36+00:00 |
Last Scan
Scanned | 2024-09-24T06:07:36+00:00 |
URL | https://boldsky.com/robots.txt |
Redirect | https://www.boldsky.com/robots.txt |
Redirect Domain | www.boldsky.com |
Redirect Base | boldsky.com |
Domain IPs | 104.18.39.206, 172.64.148.50, 2606:4700:4400::6812:27ce, 2606:4700:4400::ac40:9432 |
Redirect IPs | 104.18.39.206, 172.64.148.50, 2606:4700:4400::6812:27ce, 2606:4700:4400::ac40:9432 |
Response IP | 172.64.148.50 |
Found | Yes |
Hash | 11e6a891efa2b87d888b0d1d4b69761811c1d39d6b366fe13059692995c9303e |
SimHash | 090ade850771 |
Groups
*
Rule | Path |
---|---|
Allow | / |
Disallow | /temp/ |
Disallow | /amphtml/temp/ |
Disallow | /404.html |
Disallow | /scripts/ |
Disallow | /*?content_id=* |
Disallow | /*?referer=* |
Disallow | /*?asid=* |
Disallow | /gadgets/ |
Disallow | /automobiles/ |
Disallow | /kamasutra/ |
Disallow | /christmas/ |
Disallow | /food/ |
Disallow | /magnificence/ |
Disallow | /movie-stills/ |
Disallow | /*?utm_* |
Disallow | /videos/amphtml/ |
Disallow | /videos/amphtml/* |
Disallow | /videos/search-videos/ |
Disallow | /videos/homepagewidget/* |
Disallow | /videos/tagfeeds/* |
Disallow | /videos/locationfeeds_es/* |
Other Records
Field | Value |
---|---|
sitemap | https://www.boldsky.com/sitemap.xml |
sitemap | https://www.boldsky.com/sitemap-latest.xml |
sitemap | https://www.boldsky.com/sitemap_news.xml |
sitemap | https://www.boldsky.com/sitemap-webstories.xml |
sitemap | https://www.boldsky.com/sitemap-videos-index.xml |
sitemap | https://www.boldsky.com/sitemap-images-index.xml |