myjobassistant.com
robots.txt

Robots Exclusion Standard data for myjobassistant.com

Resource Scan

Scan Details

Site Domain myjobassistant.com
Base Domain myjobassistant.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2026-01-19T07:39:55+00:00
Next Scan 2026-04-19T07:39:55+00:00

Last Successful Scan

Scanned2025-06-23T13:53:17+00:00
URL https://myjobassistant.com/robots.txt
Domain IPs 104.21.86.167, 172.67.222.99, 2606:4700:3032::ac43:de63, 2606:4700:3033::6815:56a7
Response IP 104.21.86.167
Found Yes
Hash b5dd687916068f7b0a6d428ae2f824d349dc59628d494754c21ac8254cb9e4ac
SimHash ba0ccd46fb40

Groups

*

Rule Path
Disallow /job_rd.php
Disallow /bounces.txt
Disallow /jobs.test.php
Disallow /rd_log.txt
Disallow /test.php
Disallow /email_creative.php
Disallow /unsub_process.php
Disallow /unsub_confirm.php
Disallow /article_old.php
Disallow /click-alt.php
Disallow /index_old.php
Disallow /click.php
Disallow /article_test.php
Disallow /receive_ses_notifications.php

siteauditbot

Rule Path
Disallow /

semrushbot-ba

Rule Path
Disallow /

semrushbot-si

Rule Path
Disallow /

semrushbot-swa

Rule Path
Disallow /

semrushbot-ct

Rule Path
Disallow /

semrushbot-bm

Rule Path
Disallow /

splitsignalbot

Rule Path
Disallow /

semrushbot-coub

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /