Log In Sign Up

applythis.net
robots.txt

Robots Exclusion Standard data for applythis.net

Resource Scan

Scan Details

Site Domain applythis.net
Base Domain applythis.net
Scan Status Ok
Last Scan2024-09-11T12:56:29+00:00
Next Scan 2024-10-11T12:56:29+00:00

Last Scan

Scanned2024-09-11T12:56:29+00:00
URL https://applythis.net/robots.txt
Domain IPs 51.140.164.131
Response IP 51.140.164.131
Found Yes
Hash 9edc05429ea53560cf20ecf75b09fde303a90d5ce8443a4991ab0fd9b21804ce
SimHash 587cabb2fe80

Groups

googlebot

Rule Path
Allow /

googlebot-image

Rule Path
Allow /

yandexadnet
yandexaccessibilitybot
yandexblogs
yandexbot
yandexcalendar
yandexmobilebot
seznambot
psbot
mj12bot
petalbot
dotbot
dataforseobot
ahrefsbot
semrushbot
magpie-crawler

Rule Path
Disallow /

*

Rule Path
Disallow *intranet*
Disallow *internal*
Disallow */account/*
Disallow */maccount/*
Disallow */thecarehub/*
Disallow */sitemap.xml*
Disallow */add/*
Disallow */search/
Disallow */search/index*
Disallow */search/sendcv*
Disallow */search/sendtoafriend*
Disallow */Search/
Disallow */Search/Index*
Disallow */Search/SendCV*
Disallow */Search/SendToAFriend*
Disallow */search/vacancy/field*
Disallow */search/vacancy/days*
Disallow */search/vacancy/location*
Disallow */search/vacancy/jobtype*
Disallow */search/vacancy/industry*
Disallow */search/vacancy/salary*
Disallow */search/vacancy/postcode*
Disallow */Search/Vacancy/Field*
Disallow */Search/Vacancy/Days*
Disallow */Search/Vacancy/Location*
Disallow */Search/Vacancy/JobType*
Disallow */Search/Vacancy/Industry*
Disallow */Search/Vacancy/Salary*
Disallow */Search/Vacancy/PostCode*
Disallow */search/results/field*
Disallow */search/results/days*
Disallow */search/results/location*
Disallow */search/results/jobtype*
Disallow */search/results/industry*
Disallow */search/results/salary*
Disallow */search/results/postcode*
Disallow */Search/Results/Field*
Disallow */Search/Results/Days*
Disallow */Search/Results/Location*
Disallow */Search/Results/Jobtype*
Disallow */Search/Results/Industry*
Disallow */Search/Results/Salary*
Disallow */Search/Results/PostCode*
Back to top