Log In Sign Up

transfermate.io
robots.txt

Robots Exclusion Standard data for transfermate.io

Resource Scan

Scan Details

Site Domain transfermate.io
Base Domain transfermate.io
Scan Status Ok
Last Scan2024-09-21T11:39:40+00:00
Next Scan 2024-10-21T11:39:40+00:00

Last Scan

Scanned2024-09-21T11:39:40+00:00
URL https://transfermate.io/robots.txt
Redirect https://www.transfermate.io/robots.txt
Redirect Domain www.transfermate.io
Redirect Base transfermate.io
Domain IPs 18.155.68.21, 18.155.68.33, 18.155.68.66, 18.155.68.69
Redirect IPs 18.155.68.21, 18.155.68.33, 18.155.68.66, 18.155.68.69
Response IP 18.155.68.66
Found Yes
Hash 398e904fba32825e5e85735a2afb42ce1365ca9cf0809ede95617ab4b8718a68
SimHash 3e5452d176de

Groups

semrushbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

semrushbot-sa

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

mj12bot

Rule Path
Disallow /

*

Rule Path
Disallow /sitemaps.xml
Disallow *mtra.asp*
Disallow *exchange_rates_api.asp*
Disallow *exchange-rates-usd-gbp-eur.asp*
Disallow *partner_home.asp*
Disallow *partner_vrt_home.asp*
Disallow *student_transfers_info.asp*
Disallow *xabout_us.html*
Disallow *xbenefits.html*
Disallow *xrates_thankyou.html*
Disallow *pabout_us.html*
Disallow *partner_converters.asp*
Disallow *partner_converters_france.asp*
Disallow *partner_converters_home.asp*
Disallow *partner_converters_paytostudy.asp*
Disallow *partner_converters_usa.asp*
Disallow *xcontact_us.html*
Disallow *xsobre_nosotros.html*
Disallow *transferencias-para-estudiantes-info.asp*
Disallow *xtipos_de_cambio_gracias.html*
Disallow *tipo-cambio-usd-gbp-eur.asp*
Disallow *xbeneficios.html*
Disallow *socio_inicio.asp*
Disallow *xcontactenos.html*
Disallow *inicio_hacerse_socio.asp*
Disallow *a-propos.html*
Disallow *transferts-etudiants-renseignements.asp*
Disallow *taux-de-change-merci.html*
Disallow *partenaire-vrt-accueil.asp*
Disallow *taux-de-change-usd-gbp-eur.asp*
Disallow *xavantages.html*
Disallow *partenaire-accueil.asp*
Disallow *xcontactez-nous.html*
Disallow *convertissuers-devises-partenaires-accueil.asp*

Other Records

Field Value
crawl-delay 3
Back to top

Comments

  • robots.txt, 17/07/2017
Back to top

Warnings

  • 2 invalid lines.
Back to top