e-aidem.com
robots.txt

Robots Exclusion Standard data for e-aidem.com

Resource Scan

Scan Details

Site Domain e-aidem.com
Base Domain e-aidem.com
Scan Status Ok
Last Scan2024-06-18T11:49:32+00:00
Next Scan 2024-07-02T11:49:32+00:00

Last Scan

Scanned2024-06-18T11:49:32+00:00
URL https://www.e-aidem.com/robots.txt
Domain IPs 13.227.254.108, 13.227.254.26, 13.227.254.46, 13.227.254.97
Response IP 13.227.254.97
Found Yes
Hash 5fa01c29af95ac4a50a7ff105dc9f1fa624f9a1ae0e18115a30ff817ac554d0c
SimHash 8b140ab62194

Groups

y!j-brj/yats crawler

Rule Path
Disallow /

googlebot

Rule Path
Disallow /aps/m/
Disallow /shain/m/
Disallow /*mob.htm$
Disallow /f/
Disallow /member/
Disallow /jigsaw/
Disallow /api/recommend/
Disallow /aps/api/
Disallow /aps/*?max_view=*
Disallow /aps/*?NOI=*
Disallow /aps/*?val70=*
Allow /aps/*_pref.htm?mode=listPrefecture*
Allow /aps/*_rail.htm?mode=listRoute*
Allow /aps/search.htm?mode=listRoute*
Allow /aps/*_job.htm?mode=listOccupation*
Allow /aps/search.htm?mode=listStation*
Allow /aps/*_sta.htm?mode=listStation
Disallow /aps/*?mode=*
Disallow /aps/*?page=*
Disallow /aps/*?sort=*
Disallow /aps/*?max=*
Disallow /aps/*?doing_wp_cron=*
Disallow /aps/*?PS=*
Disallow /aps/*?utm_source=*
Disallow /aps/*?val60=*
Disallow /aps/assets/salary/*
Disallow /aps/list.htm?type=company&sch=1&region_id=

Other Records

Field Value
sitemap https://www.e-aidem.com/sitemap/sitemap_clp_index.xml
sitemap https://www.e-aidem.com/sitemap/sitemap_contents_index.xml
sitemap https://www.e-aidem.com/sitemap/sitemap_entame_index.xml
sitemap https://www.e-aidem.com/sitemap/new_sitemap_detail_1.xml.gz
sitemap https://www.e-aidem.com/sitemap/new_sitemap_detail_2.xml.gz
sitemap https://www.e-aidem.com/sitemap/new_sitemap_detail_3.xml.gz
sitemap https://www.e-aidem.com/sitemap/new_sitemap_detail_4.xml.gz
sitemap https://www.e-aidem.com/sitemap/new_sitemap_detail_5.xml.gz
sitemap https://www.e-aidem.com/sitemap/sitemap_list_city_1.xml
sitemap https://www.e-aidem.com/sitemap/sitemap_list_station_1.xml