Log In Sign Up

atlasworldgroupinc.com
robots.txt

Robots Exclusion Standard data for atlasworldgroupinc.com

Resource Scan

Scan Details

Site Domain atlasworldgroupinc.com
Base Domain atlasworldgroupinc.com
Scan Status Ok
Last Scan2025-07-20T03:08:05+00:00
Next Scan 2025-08-19T03:08:05+00:00

Last Scan

Scanned2025-07-20T03:08:05+00:00
URL https://atlasworldgroupinc.com/robots.txt
Domain IPs 199.60.103.134, 199.60.103.34
Response IP 199.60.103.34
Found Yes
Hash 99e64d2869f268cd7ec2b63b6eace197e97c33f1f48c48d92a585ff58cb24bae
SimHash 21555137b771

Groups

*

Rule Path
Disallow /hs-search
Disallow /*?*page=
Disallow /*?*pageId=
Disallow /topic/
Disallow /tag/
Disallow /tags/
Disallow /author/
Disallow /authors/
Disallow /preview/
Disallow /__hs_preview/
Disallow /hubfs/
Disallow /hs-fs/
Disallow /hs/
Disallow /_hcms/
Disallow /email/
Disallow /meetings/
Allow /resources/
Allow /amplifier/
Allow /city-guides/
Disallow /_hcms/preview/
Disallow /hs/manage-preferences/
Disallow /hs/preferences-center/
Disallow /*?*hs_preview=*
Disallow /*?*hsCacheBuster=*
Back to top

Other Records

Field Value
sitemap https://www.atlasvanlines.com/sitemap.xml
Back to top

Comments

  • Disallow internal search results pages
  • Disallow paginated URLs (e.g., ?page=2 or ?pageId=123)
  • Disallow topic and tag index pages
  • Disallow author pages
  • Disallow preview pages
  • Disallow HubSpot system files and folders
  • Disallow email and tracking URLs
  • Disallow calendar and meeting links
  • Allow important public-facing blog posts and landing pages
  • Sitemap directive (adjust the URL if needed)
Back to top