Add dotnet test integration tests for all Apple platforms

[jonathanpeppers]

This PR adds end-to-end dotnet test integration tests for all Apple platforms (iOS, tvOS, Mac Catalyst, macOS) using the MTP (Microsoft Testing Platform) test templates.

Changes

• tests/dotnet/UnitTests/DotNetTestTest.cs: New parameterized test that creates a project from dotnet new <template>, replaces the generated tests with a single passing test, and runs dotnet test.
• tests/common/DotNet.cs: Added test verb support to DotNet.Execute.

The test reads the MLAUNCH_PATH environment variable to override the mlaunch binary for mobile platforms (iOS/tvOS), enabling testing with the MTP-enabled mlaunch build.

Screenshot

Related

Depends on mlaunch MTP support: https://devdiv.visualstudio.com/DevDiv/_git/macios-mlaunch/pullrequest/734978

[vs-mobiletools-engineering-service2]

✅ [PR Build #3ac3a0c] Build passed (Build packages) ✅

Pipeline on Agent
Hash: 3ac3a0cce041601119b6c47280aeaf380c2406a4 [PR build]

[vs-mobiletools-engineering-service2]

✅ [PR Build #3ac3a0c] Build passed (Build macOS tests) ✅

Pipeline on Agent
Hash: 3ac3a0cce041601119b6c47280aeaf380c2406a4 [PR build]

[vs-mobiletools-engineering-service2]

✅ [PR Build #3ac3a0c] Build passed (Detect API changes) ✅

Pipeline on Agent
Hash: 3ac3a0cce041601119b6c47280aeaf380c2406a4 [PR build]

[vs-mobiletools-engineering-service2]

✅ API diff for current PR / commit

NET (empty diffs)

• iOS: vsdrops gist ( No breaking changes )
• tvOS: vsdrops gist ( No breaking changes )
• MacCatalyst: vsdrops gist ( No breaking changes )
• macOS: vsdrops gist ( No breaking changes )

✅ API diff vs stable

NET (empty diffs)

• iOS: vsdrops gist ( No breaking changes )
• tvOS: vsdrops gist ( No breaking changes )
• MacCatalyst: vsdrops gist ( No breaking changes )
• macOS: vsdrops gist ( No breaking changes )

ℹ️ Generator diff

Generator Diff: vsdrops (html) vsdrops (raw diff) gist (raw diff) - Please review changes)

Pipeline on Agent
Hash: 3ac3a0cce041601119b6c47280aeaf380c2406a4 [PR build]

[vs-mobiletools-engineering-service2]

✅ [CI Build #a5ba4e4] Prepare .NET Release succeeded ✅

📦 Published NuGet packages (32 packages)

iOS

• Microsoft.iOS.Ref.net11.0_26.5.26.5.11791-net11-p7.nupkg
• Microsoft.iOS.Runtime.ios-arm64.net11.0_26.5.26.5.11791-net11-p7.nupkg
• Microsoft.iOS.Runtime.ios.net11.0_26.5.26.5.11791-net11-p7.nupkg
• Microsoft.iOS.Runtime.iossimulator-arm64.net11.0_26.5.26.5.11791-net11-p7.nupkg
• Microsoft.iOS.Runtime.iossimulator-x64.net11.0_26.5.26.5.11791-net11-p7.nupkg
• Microsoft.iOS.Sdk.net11.0_26.5.26.5.11791-net11-p7.nupkg
• Microsoft.iOS.Templates.26.5.11791-net11-p7.nupkg
• Microsoft.iOS.Windows.Sdk.net11.0_26.5.26.5.11791-net11-p7.nupkg
• Microsoft.NET.Sdk.iOS.Manifest-11.0.100-preview.6.26.5.11791-net11-p7.nupkg

MacCatalyst

• Microsoft.MacCatalyst.Ref.net11.0_26.5.26.5.11791-net11-p7.nupkg
• Microsoft.MacCatalyst.Runtime.maccatalyst-arm64.net11.0_26.5.26.5.11791-net11-p7.nupkg
• Microsoft.MacCatalyst.Runtime.maccatalyst-x64.net11.0_26.5.26.5.11791-net11-p7.nupkg
• Microsoft.MacCatalyst.Runtime.maccatalyst.net11.0_26.5.26.5.11791-net11-p7.nupkg
• Microsoft.MacCatalyst.Sdk.net11.0_26.5.26.5.11791-net11-p7.nupkg
• Microsoft.MacCatalyst.Templates.26.5.11791-net11-p7.nupkg
• Microsoft.NET.Sdk.MacCatalyst.Manifest-11.0.100-preview.6.26.5.11791-net11-p7.nupkg

macOS

• Microsoft.macOS.Ref.net11.0_26.5.26.5.11791-net11-p7.nupkg
• Microsoft.macOS.Runtime.osx-arm64.net11.0_26.5.26.5.11791-net11-p7.nupkg
• Microsoft.macOS.Runtime.osx-x64.net11.0_26.5.26.5.11791-net11-p7.nupkg
• Microsoft.macOS.Runtime.osx.net11.0_26.5.26.5.11791-net11-p7.nupkg
• Microsoft.macOS.Sdk.net11.0_26.5.26.5.11791-net11-p7.nupkg
• Microsoft.macOS.Templates.26.5.11791-net11-p7.nupkg
• Microsoft.NET.Sdk.macOS.Manifest-11.0.100-preview.6.26.5.11791-net11-p7.nupkg

tvOS

• Microsoft.NET.Sdk.tvOS.Manifest-11.0.100-preview.6.26.5.11791-net11-p7.nupkg
• Microsoft.tvOS.Ref.net11.0_26.5.26.5.11791-net11-p7.nupkg
• Microsoft.tvOS.Runtime.tvos-arm64.net11.0_26.5.26.5.11791-net11-p7.nupkg
• Microsoft.tvOS.Runtime.tvos.net11.0_26.5.26.5.11791-net11-p7.nupkg
• Microsoft.tvOS.Runtime.tvossimulator-arm64.net11.0_26.5.26.5.11791-net11-p7.nupkg
• Microsoft.tvOS.Runtime.tvossimulator-x64.net11.0_26.5.26.5.11791-net11-p7.nupkg
• Microsoft.tvOS.Sdk.net11.0_26.5.26.5.11791-net11-p7.nupkg
• Microsoft.tvOS.Templates.26.5.11791-net11-p7.nupkg

Other

• Sharpie.Bind.Tool.26.6.0.395-net11-p7.nupkg

Pipeline on Agent
Hash: a5ba4e44c92f22d95edd7e6e1edd3a8055e40cdc [PR build]

[vs-mobiletools-engineering-service2]

🔥 [CI Build #3ac3a0c] Test results 🔥

Test results

❌ Tests failed on VSTS: test results

0 tests crashed, 1 tests failed, 207 tests passed.

Failures

❌ dotnettests tests (MacCatalyst)

1 tests failed, 0 tests passed.

Failed tests

• DotNet tests: Failed (Execution failed with exit code 1)
  • Xamarin.Tests.DotNetProjectTest.Run(MacCatalyst,True): System.IO.FileNotFoundException : Could not find file '/Users/cloudtest/vss/_work/1/s/macios/tests/dotnet/UnitTests/bin/Debug/ne...

Html Report (VSDrops) Download

Successes

✅ assembly-processing: All 1 tests passed. Html Report (VSDrops) Download
✅ cecil: All 1 tests passed. Html Report (VSDrops) Download
✅ dotnettests (iOS): All 1 tests passed. Html Report (VSDrops) Download
✅ dotnettests (macOS): All 1 tests passed. Html Report (VSDrops) Download
✅ dotnettests (Multiple platforms): All 1 tests passed. Html Report (VSDrops) Download
✅ dotnettests (tvOS): All 1 tests passed. Html Report (VSDrops) Download
✅ framework: All 2 tests passed. Html Report (VSDrops) Download
✅ fsharp: All 4 tests passed. Html Report (VSDrops) Download
✅ generator: All 5 tests passed. Html Report (VSDrops) Download
✅ interdependent-binding-projects: All 4 tests passed. Html Report (VSDrops) Download
✅ introspection: All 4 tests passed. Html Report (VSDrops) Download
✅ linker (iOS): All 21 tests passed. Html Report (VSDrops) Download
✅ linker (MacCatalyst): All 21 tests passed. Html Report (VSDrops) Download
✅ linker (macOS): All 21 tests passed. Html Report (VSDrops) Download
✅ linker (tvOS): All 21 tests passed. Html Report (VSDrops) Download
✅ monotouch (iOS): All 18 tests passed. Html Report (VSDrops) Download
✅ monotouch (MacCatalyst): All 18 tests passed. Html Report (VSDrops) Download
✅ monotouch (macOS): All 18 tests passed. Html Report (VSDrops) Download
✅ monotouch (tvOS): All 18 tests passed. Html Report (VSDrops) Download
✅ msbuild: All 2 tests passed. Html Report (VSDrops) Download
✅ sharpie: All 1 tests passed. Html Report (VSDrops) Download
✅ windows: All 3 tests passed. Html Report (VSDrops) Download
✅ xcframework: All 4 tests passed. Html Report (VSDrops) Download
✅ xtro: All 1 tests passed. Html Report (VSDrops) Download

macOS tests

✅ Tests on macOS Sonoma (14): All 5 tests passed. Html Report (VSDrops) Download
✅ Tests on macOS Sequoia (15): All 5 tests passed. Html Report (VSDrops) Download
✅ Tests on macOS Tahoe (26): All 5 tests passed. Html Report (VSDrops) Download

Linux Build Verification

✅ Linux build succeeded

Pipeline on Agent
Hash: 3ac3a0cce041601119b6c47280aeaf380c2406a4 [PR build]