mid-works.com
robots.txt

Robots Exclusion Standard data for mid-works.com

Resource Scan

Scan Details

Site Domain mid-works.com
Base Domain mid-works.com
Scan Status Ok
Last Scan2024-05-17T14:19:04+00:00
Next Scan 2024-06-16T14:19:04+00:00

Last Scan

Scanned2024-05-17T14:19:04+00:00
URL https://mid-works.com/robots.txt
Domain IPs 108.156.133.126, 108.156.133.23, 108.156.133.46, 108.156.133.84
Response IP 108.156.133.84
Found Yes
Hash 5b93c61ee35e23f08c6ed8d2f0b1b9f4df9421252be66c1e84ed9c9aaea08ae2
SimHash 1d56de04c5d9

Groups

*

Rule Path
Disallow /special/
Disallow /news/
Disallow /project/
Disallow /redirect_word_press/
Disallow /freelance-financial-knowledge/
Disallow /freelance-and-insurance/
Disallow /freelance-career/
Disallow /freelance-wordlist/
Disallow /freelance-engineer-knowhow/
Disallow /feature/
Disallow /manage/
Disallow /admin/
Disallow /password_resets/
Disallow /mypage/

baiduspider

Rule Path
Disallow /

baiduspider+

Rule Path
Disallow /

baidumobaider

Rule Path
Disallow /

baiduimagespider

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /