thaitools.techPractical tools for life in Thailand
English interface

robots.txt generator

Generate user-agent, allow, disallow and sitemap directives.

ReviewedCheck before reuse
Saves this tool's name on this device only (up to 20). No form values.
Only visible result text is included. Form fields are not read. Review sensitive values before sharing.

Processed locally. Review generated code before deployment.

Enter values, then process to see the result.

How to use it

  1. Paste or enter input within the displayed limit for robots.txt generator.
  2. Generate user-agent, allow, disallow and sitemap directives.
  3. Validate the output against the documented format and limitations before production use.

Important limitation

robots.txt is not access control and disallowed URLs may still be discovered.

The interactive form is fully localized in English.

Reviewed 2026-09-16; next review 2027-03-16.

Core calculations, cited sources and main examples have been reviewed within the stated scope.

Sources

RFC 9309 — Robots Exclusion ProtocolIETF / RFC Editor · opens in a new tabGenerates user-agent, allow, disallow and sitemap directives.Source checked 2026-09-16
Recorded updates

Review history

Site changelog

Dates describe the review scope recorded below. A page update does not mean every source was checked again.

  1. Last recorded source/method review

    Core calculations, cited sources and main examples have been reviewed within the stated scope.

Related guides

Check a web page from metadata through sitemap publicationUnderstand the meaning, scope and sources before using the result.

Related tools

JSON formatter and syntax validatorFormat or minify JSON locally while preserving original numeric tokens.UTF-8 Base64 text converterEncode or decode standard Base64 text locally, including Thai and emoji.YAML formatter and validatorParse and format YAML 1.2 while checking duplicate keys.XML formatter and validatorValidate and format well-formed XML with DOCTYPE blocked.