Environment selection
Some tests are designed to be run against specific environments or pipelines.
We can specify what environments or pipelines to run tests against using the only
metadata.
Available switches
Switch | Function | Type |
---|---|---|
tld
| Set the top-level domain matcher | String
|
subdomain
| Set the subdomain matcher |
Array or String
|
domain
| Set the domain matcher | String
|
production
| Match against production | Static
|
pipeline
| Match against a pipeline |
Array or Static
|
:production
and { <switch>: 'value' }
simultaneously.
These options are mutually exclusive. If you want to specify production, you
can control the tld
and domain
independently.Examples
Environment or pipeline | Key | Matches (regex for environments, string matching for pipelines) |
---|---|---|
any
| `` | .+.com
|
gitlab.com
| only: :production
| gitlab.com
|
staging.gitlab.com
| only: { subdomain: :staging }
| (staging).+.com
|
gitlab.com and staging.gitlab.com
| only: { subdomain: /(staging.)?/, domain: 'gitlab' }
| (staging.)?gitlab.com
|
dev.gitlab.org
| only: { tld: '.org', domain: 'gitlab', subdomain: 'dev' }
| (dev).gitlab.org
|
staging.gitlab.com & domain.gitlab.com
| only: { subdomain: %i[staging domain] }
| (staging|domain).+.com
|
nightly
| only: { pipeline: :nightly }
| “nightly” |
nightly , canary
| only: { pipeline: [:nightly, :canary] }
| “nightly” and “canary” |
RSpec.describe 'Area' do
it 'runs in any environment or pipeline' do; end
it 'runs only in production environment', only: :production do; end
it 'runs only in staging environment', only: { subdomain: :staging } do; end
it 'runs in dev environment', only: { tld: '.org', domain: 'gitlab', subdomain: 'dev' } do; end
it 'runs in prod and staging environments', only: { subdomain: /(staging.)?/, domain: 'gitlab' } {}
it 'runs only in nightly pipeline', only: { pipeline: :nightly } do; end
it 'runs in nightly and canary pipelines', only: { pipeline: [:nightly, :canary] } do; end
end
If the test has a before
or after
, you must add the only
metadata
to the outer RSpec.describe
.
If you want to run an only: { :pipeline }
tagged test on your local GDK make sure either the CI_PROJECT_NAME
CI/CD variable is unset, or that the CI_PROJECT_NAME
variable matches the specified pipeline in the only: { :pipeline }
tag, or just delete the only: { :pipeline }
tag.
Quarantining a test for a specific environment
Similarly to specifying that a test should only run against a specific environment, it’s also possible to quarantine a
test only when it runs against a specific environment. The syntax is exactly the same, except that the only: { ... }
hash is nested in the quarantine: { ... }
hash.
For instance, quarantine: { only: { subdomain: :staging } }
only quarantines the test when run against staging.