swift-dm.com
robots.txt

Robots Exclusion Standard data for swift-dm.com

Resource Scan

Scan Details

Site Domain swift-dm.com
Base Domain swift-dm.com
Scan Status Ok
Last Scan2025-05-26T21:14:21+00:00
Next Scan 2025-06-25T21:14:21+00:00

Last Scan

Scanned2025-05-26T21:14:21+00:00
URL https://swift-dm.com/robots.txt
Redirect https://www.swift-dm.com/robots.txt
Redirect Domain www.swift-dm.com
Redirect Base swift-dm.com
Domain IPs 199.34.228.41
Redirect IPs 199.34.228.41
Response IP 199.34.228.41
Found Yes
Hash 9faaab6eb1edb01710b9e301e269f5e8102485ee283fc3319e3eb5ffb45bee24
SimHash b040b8f6ee92

Groups

nerdybot

Rule Path
Disallow /

dotbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

*

Rule Path
Disallow /ajax/
Disallow /apps/
Disallow /seo-and-revenue-generation.html
Disallow /get-your-quote.html
Disallow /home-copy.html
Disallow /custom-web-design.html
Disallow /about-us.html
Disallow /social-media-design-services.html
Disallow /blog.html
Disallow /1/
Disallow /blog/
Disallow /blog
Disallow /social-media-advertising-services.html
Disallow /home-dup.html
Disallow /additional-comments.html

Other Records

Field Value
sitemap https://www.swift-dm.com/sitemap.xml