softswiss.com
robots.txt

Robots Exclusion Standard data for softswiss.com

Resource Scan

Scan Details

Site Domain softswiss.com
Base Domain softswiss.com
Scan Status Ok
Last Scan2024-09-01T12:40:26+00:00
Next Scan 2024-10-01T12:40:26+00:00

Last Scan

Scanned2024-09-01T12:40:26+00:00
URL https://softswiss.com/robots.txt
Redirect https://www.softswiss.com/robots.txt
Redirect Domain www.softswiss.com
Redirect Base softswiss.com
Domain IPs 104.18.34.98, 172.64.153.158
Redirect IPs 104.18.34.98, 172.64.153.158
Response IP 104.18.34.98
Found Yes
Hash b5e6f53e44ce8ae9bcdf172bfea98318fd65fa062c57e1ff76730b2daf17d608
SimHash 2014da0299f0

Groups

*

Rule Path
Disallow /cgi-bin
Disallow /wp-
Disallow /wp/
Disallow /author/
Disallow */page/
Disallow */search/
Disallow /feed
Disallow /feed/$
Disallow /*/feed/$
Disallow /*/feed/rss/$
Disallow /*/trackback/$
Disallow /*/*/feed/$
Disallow /*/*/feed/rss/$
Disallow /*/*/trackback/$
Disallow /*/*/*/feed/$
Disallow /*/*/*/feed/rss/$
Disallow /*/*/*/trackback/$
Disallow *?wordfence*
Disallow *?wordfence_lh=*
Disallow /*.pdf$
Allow */uploads
Allow /*/*.js
Allow /*/*.css
Allow /wp-*.png
Allow /wp-*.jpg
Allow /wp-*.jpeg
Allow /wp-*.gif
Allow /wp-*.svg
Allow /wp-*.pdf
Allow /wp-*.ico
Allow /wp-admin/admin-ajax.php
Allow /news/feed/

ia_archiver

Rule Path
Disallow /

james bot - webcrawler

Rule Path
Disallow /

hubspot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.softswiss.com/sitemap_index.xml

Warnings

  • 2 invalid lines.