em.ag
robots.txt

Robots Exclusion Standard data for em.ag

Resource Scan

Scan Details

Site Domain em.ag
Base Domain em.ag
Scan Status Ok
Last Scan2025-07-14T13:27:31+00:00
Next Scan 2025-08-13T13:27:31+00:00

Last Scan

Scanned2025-07-14T13:27:31+00:00
URL https://em.ag/robots.txt
Domain IPs 185.89.56.162
Response IP 185.89.56.162
Found Yes
Hash 9cab625a48fbd4e3cae0cdc53e6debad68e673c5fcc60e982eec506e1480bbce
SimHash 24da889b24a0

Groups

*

Rule Path
Allow /wp-admin/admin-ajax.php
Disallow /wp-admin/
Disallow /epd2019/21_marckilgus/feed/
Disallow /jobs/cad-berater-m-w-nx-maschinen-anlagenbau/cadbernx/feed/
Disallow /plm_service/*
Disallow /produkte/anark/anark_performance_740px/
Disallow /reqman-doors/doors_price_bumper_250px_en-2/
Disallow /*.pdf
Disallow /*.PDF
Disallow /*.svg
Disallow /*.SVG
Disallow /*.ai
Disallow /*.AI
Disallow /tag/*
Disallow /events/*
Disallow /2001/
Disallow /2002/
Disallow /2003/
Disallow /2004/
Disallow /2005/
Disallow /2006/
Disallow /2007/
Disallow /2008/
Disallow /2009/
Disallow /2010/
Disallow /2011/
Disallow /2012/
Disallow /2013/
Disallow /2014/
Disallow /2015/
Disallow /2016/
Disallow /2017/
Disallow /2018/
Disallow /2019/
Disallow /2020/
Disallow /20180705_stellenanzeige_azubi_buero/
Disallow /em_cadfeature/
Disallow /agb/
Disallow /index.php?id=185
Disallow /20180629_stellenanzeige_senior_management-berater_digital/
Disallow /events/list/
Disallow /20180629_stellenanzeige_senior_mbse-berater/
Disallow /2018-02_itp_reqman/
Disallow /download/*
Disallow /downloads/*
Disallow /fileadmin/*
Disallow /em_reqman_dt/
Disallow /2016-05_oem_anforderungsmgmt/
Disallow */page/*
Disallow /2015-02_pdj_multicad-system/
Disallow /branche_typ/*
Disallow /2015/10/01/wp_multicad-nx-jt-datenaustausch-2/
Disallow /2016/01/30/datenaufbereitung-nxjt-datenaustausch-mit-daimler/
Disallow /em_caddoctor_for_jt/*
Disallow /20*
Disallow /produkt/reqman/
Disallow /2016_08_em_wp_tdse_mbse-prinzipien/
Disallow /suche/*
Disallow /unternehmensbereiche/*
Disallow /en/news/*
Disallow /en/news-en/*
Disallow /news/*
Disallow /en/reqnews-en/*
Disallow /reqnews/*
Disallow */download/
Disallow */category/*

ahrefsbot*

Rule Path
Disallow /

dotbot*

Rule Path
Disallow /

mj12bot*

Rule Path
Disallow /

seoscanners.net*

Rule Path
Disallow /

seokicks-robot*

Rule Path
Disallow /

jooblebot*

Rule Path
Allow /jobs/*
Allow /karriere/jobs
Disallow /

semrushbot*

Rule Path
Disallow /

arquivo-web-crawler*

Rule Path
Disallow /

jobboersebot*

Rule Path
Allow /jobs/*
Allow /karriere/jobs
Disallow /

apis-google*

Rule Path
Allow *

nimbostratus-bot*

Rule Path
Disallow /

seznambot*

Rule Path
Disallow /

ahrefsbot*

Rule Path
Disallow /

twitterbot*

Rule Path
Disallow /

screaming frog seo spider*

Rule Path
Disallow /*.pdf
Disallow /*.png
Disallow /*.jpg
Disallow /*.jpeg