softwareadvice.com
robots.txt
Robots Exclusion Standard data for softwareadvice.com
Resource Scan
Scan Details
Site Domain | softwareadvice.com |
Base Domain | softwareadvice.com |
Scan Status | Ok |
Last Scan | 2024-11-04T11:03:53+00:00 |
Next Scan | 2024-11-18T11:03:53+00:00 |
Last Scan
Scanned | 2024-11-04T11:03:53+00:00 |
URL | https://softwareadvice.com/robots.txt |
Redirect | https://www.softwareadvice.com/robots.txt |
Redirect Domain | www.softwareadvice.com |
Redirect Base | softwareadvice.com |
Domain IPs | 104.16.136.228, 104.16.137.228 |
Redirect IPs | 104.16.136.228, 104.16.137.228 |
Response IP | 104.16.136.228 |
Found | Yes |
Hash | 6dc3dae73527adc5e031ee90599fde7d953509977634560ca63e9d59f5633ad7 |
SimHash | 281a712bcf60 |
Groups
*
Rule | Path |
---|---|
Allow | / |
Allow | /articles/feed/rss/ |
Allow | /articles/feed/ |
Allow | /articles/rss |
*
Rule | Path |
---|---|
Disallow | /imglib/screenshot_ |
Disallow | /*trackback |
Disallow | /*feed$ |
Disallow | /*feed/$ |
Disallow | /extranet/ |
Disallow | /partners/ |
Disallow | /contrib/flowplayer |
Disallow | /*screenshots-raw/ |
Disallow | /includes/templates/notice_and_procedure.pdf |
Disallow | /search* |
Disallow | /*-profile/vs/*/*/ |
Disallow | /*review%3D |
Disallow | /*reviews%3D |
Disallow | /*sort%3D |
Disallow | /*more%3D |
Disallow | /*.woff$ |
Disallow | /*.woff2$ |
Disallow | /api/* |
Disallow | /compare/*-*/vs/*-*/*/ |
Disallow | /js/product_reveal_gdm_ajax.js |
Disallow | /ajax/gdm_reviews_ajax_smarty.php |
Other Records
Field | Value |
---|---|
sitemap | https://www.softwareadvice.com/sitemap.xml |
Comments