itsscb/rust
1
0
Fork 0
mirror of https://github.com/rust-lang/rust.git synced 2025-11-29 07:07:26 +00:00
Code Issues Packages Projects Releases Wiki Activity
rust/tests/run-make
History
bors c90bcb9571 Auto merge of #148573 - matthiaskrgr:rollup-cn5viia, r=matthiaskrgr 
Rollup of 7 pull requests

Successful merges:

 - rust-lang/rust#146861 (add extend_front to VecDeque with specialization like extend)
 - rust-lang/rust#148213 (Fix invalid tag closing when leaving expansion "original code")
 - rust-lang/rust#148292 (Un-shadow object bound candidate in `NormalizesTo` goal if self_ty is trait object)
 - rust-lang/rust#148528 (run-make tests: use edition 2024)
 - rust-lang/rust#148554 (Add regression test for issue 148542)
 - rust-lang/rust#148561 (Fix ICE from async closure variance)
 - rust-lang/rust#148563 (rustdoc-search: remove broken index special case)

r? `@ghost`
`@rustbot` modify labels: rollup
2025-11-06 14:52:37 +00:00
..
a-b-a-linker-guard
…
alloc-no-oom-handling
…
alloc-no-rc
…
alloc-no-sync
…
allocator-shim-circular-deps
…
allow-warnings-cmdline-stability
…
amdgpu-kd
…
apple-c-available-links
…
apple-deployment-target
…
apple-sdk-version
…
archive-duplicate-names
…
arguments-non-c-like-enum
…
arm64ec-import-export-static
…
artifact-incr-cache
…
artifact-incr-cache-no-obj
…
atomic-lock-free
…
autodiff/type-trees
…
avr-rjmp-offset
…
bare-outfile
…
bin-emit-no-symbols
…
box-struct-no-segfault
…
branch-protection-check-IBT
…
broken-pipe-no-ice
…
c-dynamic-dylib
…
c-dynamic-rlib
…
c-link-to-rust-dylib
…
c-link-to-rust-staticlib
…
c-link-to-rust-va-list-fn
…
c-static-dylib
…
c-static-rlib
…
c-unwind-abi-catch-lib-panic
…
c-unwind-abi-catch-panic
…
cdylib
…
cdylib-dylib-linkage
…
cdylib-fewer-symbols
…
checksum-freshness
…
clear-error-blank-output
…
codegen-options-parsing
…
comment-section
…
compile-stdin
…
compiler-lookup-paths
…
compiler-lookup-paths-2
…
compiler-rt-works-on-mingw
…
compiletest-self-test/symbols-helpers
…
compressed-debuginfo
…
compressed-debuginfo-zstd
…
const_fn_mir
…
const-prop-lint
…
const-trait-stable-toolchain
…
core-no-fp-fmt-parse
…
core-no-oom-handling
…
cpp-global-destructors
…
crate-circular-deps-link
…
crate-data-smoke
…
crate-hash-rustc-version
…
crate-loading
…
crate-loading-crate-depends-on-itself
…
crate-loading-multiple-candidates
…
crate-name-priority
…
cross-lang-lto
…
cross-lang-lto-clang
…
cross-lang-lto-pgo-smoketest-clang
…
cross-lang-lto-riscv-abi
…
cross-lang-lto-upstream-rlibs
…
CURRENT_RUSTC_VERSION
…
debug-assertions
…
debugger-visualizer-dep-info
…
dep-graph
…
dep-info
…
deref-impl-rustdoc-ice
…
diagnostics-traits-from-duplicate-crates
Add new run_make_support::CompletedProcess::assert_ice method
2025-11-05 22:43:25 +01:00
dirty-incr-due-to-hard-link
…
doctests-compilation-time-info
…
doctests-keep-binaries
…
doctests-keep-binaries-2024
…
doctests-merge
…
doctests-runtool
…
dos-device-input
…
dump-ice-to-disk
…
dump-mono-stats
…
duplicate-dependency
…
duplicate-output-flavors
…
dylib-chain
…
dylib-soname
…
embed-metadata
…
embed-source-dwarf
…
emit
…
emit-named-files
…
emit-path-unhashed
…
emit-shared-files
…
emit-stack-sizes
…
emit-to-stdout
…
env-dep-info
…
error-found-staticlib-instead-crate
…
error-writing-dependencies
…
exit-code
…
export
…
export-executable-symbols
…
extern-diff-internal-name
…
extern-flag-disambiguates
…
extern-flag-fun
…
extern-flag-pathless
…
extern-flag-rename-transitive
…
extern-fn-explicit-align
…
extern-fn-generic
…
extern-fn-mangle
…
extern-fn-reachable
…
extern-fn-slice-no-ice
…
extern-fn-struct-passing-abi
…
extern-fn-with-extern-types
…
extern-fn-with-packed-struct
…
extern-fn-with-union
…
extern-multiple-copies
…
extern-multiple-copies2
…
extern-overrides-distribution
…
external-crate-panic-handle-no-lint
…
extra-filename-with-temp-outputs
…
fat-then-thin-lto
…
forced-unwind-terminate-pof
…
foreign-double-unwind
…
foreign-exceptions
…
foreign-rust-exceptions
…
glibc-staticlib-args
…
glibc-symbols-x86_64-unknown-linux-gnu
…
ice-dep-cannot-find-dep
…
ice-static-mir
…
import-macro-verbatim
…
inaccessible-temp-dir
…
include-all-symbols-linking
…
include-bytes-deps
…
incr-add-rust-src-component
…
incr-foreign-head-span
…
incr-prev-body-beyond-eof
…
incr-test-moved-file
…
incremental-debugger-visualizer
…
incremental-session-fail
…
inline-always-many-cgu
…
interdependent-c-libraries
…
intrinsic-unreachable
…
invalid-library
…
invalid-so
…
invalid-staticlib
…
invalid-symlink-search-path
…
invalid-tmpdir-env-var
…
issue-84395-lto-embed-bitcode
…
issue-107495-archive-permissions
…
issue-125484-used-dependencies
…
jobserver-error
…
json-error-no-offset
…
lib-trait-for-trait-no-ice
…
libs-through-symlinks
…
libstd-no-protected
…
libtest-json
…
libtest-junit
…
libtest-padding
…
libtest-thread-limit
…
link-arg
…
link-args-order
…
link-cfg
…
link-dedup
…
link-eh-frame-terminator
…
link-framework
…
link-native-static-lib-to-dylib
…
link-path-order
…
link-under-xcode
…
linkage-attr-framework
…
linkage-attr-on-static
…
linker-plugin-lto-fat
…
linker-warning
…
llvm-ident
…
llvm-location-discriminator-limit-dummy-span
…
llvm-outputs
…
long-linker-command-lines
…
long-linker-command-lines-cmd-exe
…
longjmp-across-rust
…
ls-metadata
…
lto-avoid-object-duplication
…
lto-dylib-dep
…
lto-empty
…
lto-linkage-used-attr
…
lto-long-filenames
…
lto-long-filenames_cn
…
lto-no-link-whole-rlib
…
lto-readonly-lib
…
lto-smoke
…
lto-smoke-c
…
macos-fat-archive
…
manual-crate-name
…
manual-link
…
many-crates-but-no-match
…
metadata-dep-info
…
metadata-flag-frobs-symbols
…
metadata-only-crate-no-ice
…
min-global-align
…
mingw-export-call-convention
…
mismatching-target-triples
…
missing-crate-dependency
…
missing-unstable-trait-bound
…
mixing-deps
…
mixing-formats
…
mixing-libs
…
moved-src-dir-fingerprint-ice
…
msvc-lld-thinlto-imp-symbols
…
msvc-wholearchive
…
mte-ffi
…
multiline-args-value
…
multiple-emits
…
musl-default-linking
…
naked-symbol-visibility
…
native-lib-alt-naming
…
native-lib-load-order
…
native-link-modifier-bundle
…
native-link-modifier-verbatim-linker
…
native-link-modifier-verbatim-rustc
…
native-link-modifier-whole-archive
…
no-alloc-shim
…
no-builtins-attribute
…
no-builtins-lto
…
no-cdylib-as-rdylib
…
no-duplicate-libs
…
no-input-file
…
no-intermediate-extras
…
non-pie-thread-local
…
non-unicode-env
…
non-unicode-in-incremental-dir
…
notify-all-emit-artifacts
…
obey-crate-type-flag
…
optimization-remarks-dir
…
optimization-remarks-dir-pgo
…
option-output-no-space
…
output-filename-conflicts-with-directory
…
output-filename-overwrites-input
…
output-type-permutations
…
output-with-hyphens
…
override-aliased-flags
…
overwrite-input
…
panic-abort-eh_frame
…
panic-impl-transitive
…
parallel-rustc-no-overwrite
…
pass-linker-flags
…
pass-linker-flags-flavor
…
pass-linker-flags-from-dep
…
pass-non-c-like-enum-to-c
…
pdb-alt-path
…
pdb-sobjname
…
pgo-branch-weights
…
pgo-embed-bc-lto
…
pgo-gen
…
pgo-gen-lto
…
pgo-gen-no-imp-symbols
…
pgo-indirect-call-promotion
…
pgo-use
…
pointer-auth-link-with-c
…
pointer-auth-link-with-c-lto-clang
…
prefer-dylib
…
prefer-rlib
…
pretty-print-to-file
…
pretty-print-with-dep-file
…
print-cfg
…
print-check-cfg
…
print-crate-root-lint-levels
…
print-native-static-libs
…
print-request-help-stable-unstable
…
print-target-cpus-native
…
print-target-list
…
print-to-output
…
proc-macro-init-order
…
proc-macro-three-crates
…
prune-link-args
…
raw-dylib-alt-calling-convention
…
raw-dylib-c
…
raw-dylib-cross-compilation
…
raw-dylib-custom-dlltool
…
raw-dylib-elf
…
raw-dylib-elf-verbatim
…
raw-dylib-elf-verbatim-absolute
…
raw-dylib-import-name-type
…
raw-dylib-inline-cross-dylib
…
raw-dylib-link-ordinal
…
raw-dylib-stdcall-ordinal
…
raw-fn-pointer-opt-undefined-behavior
…
reachable-extern-fn-available-lto
…
redundant-libs
…
relocation-model
…
relro-levels
…
remap-path-prefix
…
remap-path-prefix-dwarf
…
remove-dir-all-race
…
repr128-dwarf
…
reproducible-build
…
reproducible-build-2
…
reset-codegen-1
…
resolve-rename
…
return-non-c-like-enum
…
return-non-c-like-enum-from-c
…
rlib-chain
…
rlib-format-packed-bundled-libs
…
rlib-format-packed-bundled-libs-2
…
rlib-format-packed-bundled-libs-3
…
rmeta-preferred
…
run-in-tmpdir-self-test
…
rust-lld
…
rust-lld-custom-target
…
rust-lld-link-script-provide
…
rust-lld-x86_64-unknown-linux-gnu
…
rust-lld-x86_64-unknown-linux-gnu-dist
…
rustc-help
…
rustc-macro-dep-files
…
rustdoc-cfgspec-parsing
…
rustdoc-default-output
…
rustdoc-dep-info
…
rustdoc-determinism
…
rustdoc-doctest-output-format
…
rustdoc-error-lines
…
rustdoc-io-error
…
rustdoc-map-file
…
rustdoc-merge-no-input-finalize
Add new run_make_support::CompletedProcess::assert_ice method
2025-11-05 22:43:25 +01:00
rustdoc-output-path
…
rustdoc-output-stdout
…
rustdoc-scrape-examples-dep-info
…
rustdoc-scrape-examples-invalid-expr
…
rustdoc-scrape-examples-macros
…
rustdoc-scrape-examples-multiple
…
rustdoc-scrape-examples-ordering
…
rustdoc-scrape-examples-remap
…
rustdoc-scrape-examples-test
…
rustdoc-scrape-examples-whitespace
…
rustdoc-search-load-itemtype
…
rustdoc-shared-flags
…
rustdoc-target-modifiers
…
rustdoc-target-spec-json-path
…
rustdoc-tempdir-removal
…
rustdoc-test-args
…
rustdoc-test-builder
Add new run_make_support::CompletedProcess::assert_ice method
2025-11-05 22:43:25 +01:00
rustdoc-themes
…
rustdoc-verify-output-files
…
rustdoc-with-out-dir-option
…
rustdoc-with-output-option
…
rustdoc-with-short-out-dir-option
…
sanitizer-cdylib-link
…
sanitizer-dylib-link
…
sanitizer-staticlib-link
…
separate-link
…
separate-link-fail
…
share-generics-dylib
…
share-generics-export-again
…
short-ice
…
silly-file-names
…
simd-ffi
…
split-debuginfo
…
stable-symbol-names
…
static-dylib-by-default
…
static-extern-type
…
static-pie
…
static-unwinding
…
staticlib-blank-lib
…
staticlib-broken-bitcode
…
staticlib-dylib-linkage
…
staticlib-thin-archive
…
std-core-cycle
…
stdin-rustc
…
stdin-rustdoc
…
strip
…
suspicious-library
…
symbol-mangling-hashed
…
symbol-visibility
…
symbols-all-mangled
…
symbols-include-type-name
…
symlinked-extern
…
symlinked-libraries
…
symlinked-rlib
…
sysroot-crates-are-unstable
…
target-cpu-native
…
target-specs
…
target-without-atomic-cas
…
test-benches
…
test-harness
…
textrel-on-minimal-lib
…
track-path-dep-info
…
track-pgo-dep-info
…
translation
…
type-mismatch-same-crate-name
…
unknown-mod-stdin
…
unstable-feature-usage-metrics
…
unstable-feature-usage-metrics-incremental
…
unstable-flag-required
…
use-suggestions-rust-2018
…
used
…
used-cdylib-macos
…
used-proc-macro
…
version-check
…
version-verbose-commit-hash
…
volatile-intrinsics
…
wasm-custom-section
…
wasm-custom-sections-opt
…
wasm-exceptions-nostd
…
wasm-export-all-symbols
…
wasm-import-module
…
wasm-override-linker
…
wasm-panic-small
…
wasm-spurious-import
…
wasm-stringify-ints-small
…
wasm-symbols-different-module
…
wasm-symbols-not-exported
…
wasm-symbols-not-imported
…
wasm-unexpected-features
…
weird-output-filenames
…
windows-binary-no-external-deps
…
windows-safeseh
…
windows-spawn
…
windows-ws2_32
…
zero-extend-abi-param-passing
…
README.md
…

README.md

The run-make test suite

The run-make test suite contains tests which are the most flexible out of all the rust-lang/rust test suites. run-make tests can basically contain arbitrary code, and are supported by the run_make_support library.

Infrastructure

A run-make test is a test recipe source file rmake.rs accompanied by its parent directory (e.g. tests/run-make/foo/rmake.rs is the foo run-make test).

The implementation for collecting and building the rmake.rs recipes are in src/tools/compiletest/src/runtest.rs, in run_rmake_test.

The setup for the rmake.rs can be summarized as a 3-stage process:

  1. First, we build the run_make_support library in bootstrap as a tool lib.

  2. Then, we compile the rmake.rs "recipe" linking the support library and its dependencies in, and provide a bunch of env vars. We setup a directory structure within build/<target>/test/run-make/

    <test-name>/
    rmake.exe              # recipe binary
    rmake_out/             # sources from test sources copied over

    and copy non-rmake.rs input support files over to rmake_out/. The support library is made available as an extern prelude.

  3. Finally, we run the recipe binary and set rmake_out/ as the working directory.