Add dynamic robots.txt generation and update sitemap handling

- Remove static robots.txt file.
- Implement dynamic robots.txt generator script (`generate_robots_txt.js`) to allow hostname flexibility.
- Update sitemap generation script to also use dynamic hostname from arguments.
- Modify Vite config to include automated generation of both sitemap and robots.txt during build.
- Add `public/robots.txt` to `.gitignore`.
This commit is contained in:
geoffsee
2025-05-28 22:04:28 -04:00
parent 82ba490dae
commit db5137e772
5 changed files with 56 additions and 10 deletions

View File

@@ -1,7 +0,0 @@
User-agent: *
Allow: /
Allow: /connect
Disallow: /api
Disallow: /assets
Sitemap: https://geoff.seemueller.io/sitemap.xml