Verify test environment

[sean1588]

Verify everything is working as expected in the testing environment. Here are some suggestions of things we can verify:

• Verify content and assets are being built, deployed and served correctly from the docs testing environment
• Verify assets that are being built and served properly (verify assets are served with correct version and file name)
• Run browser tests against test website endpoint
• Check search index in algolia test app (environment) to check that we have the same number of entries as in production. This will help us verify we are not missing any content in test that is in production.

(will add more verification steps as I think of more)

[sean1588]

Test environment verification

I did a dry run of the migration process on the testing/hugo-retirement-2 branch and deployed it to the test environment, www.pulumi-test.io. Everything looks good from what I can tell.

Here are things I verified:

Number of pages built is the same between the test environment and the latest prod deployment (at the point in time).

test:

prod:

Sitemap Index Files

The sitemap index files are the same at www.pulumi-test.io/sitemap-index.xml and www.pulumi.com/sitemap-index.xml

Sitemaps

The sitemaps do contain the same number of entries. However, for some reason there seems to be a small diff in the sitemap files where one map contains some lastmod properties on some pages that it didn't before. I think this is fine though.

[prod on left, testing on right]

robots.txt

The robots .txt files look the same in both prod and testing except the one at www.pulumi-test.io/robots.txt, contains a Disallow: *. This is because it is the testing environment and we have a conditional to set this only if the environment is not production. See: https://github.com/pulumi/pulumi-hugo/blob/master/themes/default/layouts/robots.txt#L2-L4

git history retention

Algolia search indexes

algolia search-index.json files across testing and production are same length and contain all the records
www.pulumi.com/search-index.json
www.pulumi-test.io/seach-index.json