vmware.powercli + PureStoragePowershellSDK2 loaded together make PS process crashed

[yala40]

Hi All,

I'm in a very strange behavior since last update of PureStoragePowershellSDK2 in version 2.33.187, when i load, in the same script PureStoragePowershellSDK2 + vmware.powercli and while doing a simple "Connect-VIServer -Server $VIServers -Credential $credentials" the PS process crash.

All works well with previous version of purestoragepowershellSDK2 ==>2.26.70

I've try it with PS 5.1 and PS7 : same behavior.

My server is Win 2019 with last KB applied.

the Vmware.Powercli module was tested with many versions :

• 13.3.0.24145081
• 13.1.0.21624340
• 12.7.0.20091289

thanks in advance for your help.

Yala

[mikenelson-io]

What happens if you load them manually outside of the script? Does it kill the process as well? Please turn on -verbose when executing manually and post the output here.

[yala40]

Hello Mike,

in fact it is not at the loading of the module that crash happen, but the first cmdlet used of "powercli" module, like for example : Connect-VIServer -Server $VIServers -Credential $credentials

if i load them manually and execute the cmd Connect-VIServer -Server $VIServers -Credential $credentials it has the same behavior.

if i load only the powercli module it works well. Crash happen only when I load both modules (PureSDK2 + powercli) in a PS windows and following the first powercli cmdlet execution.

the verbose mode is unfortunatlly not very usefull here because PS Window is crashing before prompting anything. that is the way it can be reproduced :

import-module purestoragepowershellSDK2
$credentials = Get-Credential
$VIServers = @("vserverfqdn")
$connectedViServer = Connect-VIServer -Server $VIServers -Credential $credentials -Verbose

events like this can be seen in the "application" eventlog on the windows server when PS crashing :

Détecteur d'erreurs 1480128528040821402, type 4
Nom d’événement : APPCRASH
Réponse : Non disponible
ID de CAB : 0

Signature du problème : 
P1 : PowerShell_ISE.exe
P2 : 10.0.17763.1
P3 : d129981e
P4 : KERNELBASE.dll

thanks for your help.

[yala40]

Hi Mike,

I wish you the best for this new year, for you and all your loved ones.

I want to complete/correct what I've said in my previous post, the crash happen also when loading both module, in this order :

import-module purestoragepowershellSDK2
import-module vmware.powercli -verbose

"verbose" mode does not give any feedback on screen, the crash message is always :
Process is terminated due to StackOverFlowException.

All works well with previous version of purestoragepowershellSDK2 ==>2.26.70

thanks in advance,

Yala

[mamama1]

same here, please fix asap

[mamama1]

uninstall-Module -Name PureStoragePowerShellSDK2
Install-Module -Name PureStoragePowerShellSDK2 -RequiredVersion 2.26.70

that did the trick for me

[yala40]

Hi,

yep, PureStoragePowerShellSDK2 version 2.26.70 works well with vmware.powercli loading.

that's not the case with newer versions of PureStoragePowerShellSDK2 like version 2.33.187, which lead to a crash of PS session.

[LucasMayr]

Hello,

to further assist on tracking the issue i can confirm that downgrading PureStoragePowerShellSDK2 to Version 2.26.70 did solve the issue also in my installation. I am on:

$PSVersionTable

Name                           Value
----                           -----
PSVersion                      7.5.0
PSEdition                      Core 
GitCommitId                    7.5.0
OS                             Microsoft Windows 10.0.19045
Platform                       Win32NT
PSCompatibleVersions           {1.0, 2.0, 3.0, 4.0…}
PSRemotingProtocolVersion      2.3
SerializationVersion           1.1.0.1
WSManStackVersion              3.0

I have vmWare PowerCLI installed:

get-Module -name VMware.PowerCLI | Select-Object ModuleType, Version, Name | Format-Table -AutoSize

ModuleType Version         Name
---------- -------         ----
  Manifest 13.3.0.24145081 VMware.PowerCLI

Finding the issue seems quite hard, as it crashes the shell, and closing the shell window immediately. I tried to capture a trace by calling a subshell by running a call to powershell:

pwsh.exe -Command "Connect-Pfa2Array -Endpoint <redacted> -Credential (Get-Secret -Vault <redacted> -Name <redacted>) -IgnoreCertificateError; Connect-VIServer -Server <redacted> -Credential (Get-Secret <redacted> -Vault <redacted>)"
]633;CVault <redacted> requires a password.
Enter password:
********************************

Stack overflow.
Repeated 166 times:
--------------------------------
   at System.Reflection.RuntimeAssembly.<InternalLoad>g____PInvoke|49_0(System.Reflection.NativeAssemblyNameParts*, System.Runtime.CompilerServices.ObjectHandleOnStack, System.Runtime.CompilerServices.StackCrawlMarkHandle, Int32, System.Runtime.CompilerServices.ObjectHandleOnStack, System.Runtime.CompilerServices.ObjectHandleOnStack)
   at System.Reflection.RuntimeAssembly.InternalLoad(System.Reflection.AssemblyName, System.Threading.StackCrawlMark ByRef, System.Runtime.Loader.AssemblyLoadContext, System.Reflection.RuntimeAssembly, Boolean)
   at System.Reflection.RuntimeAssembly.InternalGetSatelliteAssembly(System.Reflection.Assembly, System.Globalization.CultureInfo, System.Version, Boolean)
   at System.Resources.ManifestBasedResourceGroveler.InternalGetSatelliteAssembly(System.Reflection.Assembly, System.Globalization.CultureInfo, System.Version)
   at System.Resources.ManifestBasedResourceGroveler.GetSatelliteAssembly(System.Globalization.CultureInfo)
   at System.Resources.ManifestBasedResourceGroveler.GrovelForResourceSet(System.Globalization.CultureInfo, System.Collections.Generic.Dictionary`2<System.String,System.Resources.ResourceSet>, Boolean, Boolean)
   at System.Resources.ResourceManager.InternalGetResourceSet(System.Globalization.CultureInfo, Boolean, Boolean)
   at System.Resources.ResourceManager.GetString(System.String, System.Globalization.CultureInfo)
   at System.Management.Automation.ErrorCategoryInfo.Ellipsize(System.Globalization.CultureInfo, System.String)
   at System.Management.Automation.ScriptBlock.GetContextFromTLS()
   at System.Management.Automation.ScriptBlock.InvokeAsDelegateHelper(System.Object, System.Object, System.Object[])
   at DynamicClass.lambda_method115(System.Runtime.CompilerServices.Closure, System.Object, System.ResolveEventArgs)
   at System.Runtime.Loader.AssemblyLoadContext.InvokeResolveEvent(System.ResolveEventHandler, System.Reflection.RuntimeAssembly, System.String)
   at System.Reflection.RuntimeAssembly.<InternalLoad>g____PInvoke|49_0(System.Reflection.NativeAssemblyNameParts*, System.Runtime.CompilerServices.ObjectHandleOnStack, System.Runtime.CompilerServices.StackCrawlMarkHandle, Int32, System.Runtime.CompilerServices.ObjectHandleOnStack, System.Runtime.CompilerServices.ObjectHandleOnStack)
--------------------------------
   at System.Reflection.RuntimeAssembly.<InternalLoad>g____PInvoke|49_0(System.Reflection.NativeAssemblyNameParts*, System.Runtime.CompilerServices.ObjectHandleOnStack, System.Runtime.CompilerServices.StackCrawlMarkHandle, Int32, System.Runtime.CompilerServices.ObjectHandleOnStack, System.Runtime.CompilerServices.ObjectHandleOnStack)
   at System.Reflection.RuntimeAssembly.InternalLoad(System.Reflection.AssemblyName, System.Threading.StackCrawlMark ByRef, System.Runtime.Loader.AssemblyLoadContext, System.Reflection.RuntimeAssembly, Boolean)
   at System.Reflection.RuntimeAssembly.InternalGetSatelliteAssembly(System.Reflection.Assembly, System.Globalization.CultureInfo, System.Version, Boolean)
   at System.Resources.ManifestBasedResourceGroveler.InternalGetSatelliteAssembly(System.Reflection.Assembly, System.Globalization.CultureInfo, System.Version)
   at System.Resources.ManifestBasedResourceGroveler.GetSatelliteAssembly(System.Globalization.CultureInfo)
   at System.Resources.ManifestBasedResourceGroveler.GrovelForResourceSet(System.Globalization.CultureInfo, System.Collections.Generic.Dictionary`2<System.String,System.Resources.ResourceSet>, Boolean, Boolean)
   at System.Resources.ResourceManager.InternalGetResourceSet(System.Globalization.CultureInfo, Boolean, Boolean)
   at System.Resources.ResourceManager.GetString(System.String, System.Globalization.CultureInfo)
   at System.SR.GetResourceString(System.String, System.String)
   at System.SR.get_MaxSentMessageSizeExceeded()
   at System.ServiceModel.Channels.BufferedMessageWriter..ctor()
   at System.ServiceModel.Channels.TextMessageEncoderFactory+TextMessageEncoder+TextBufferedMessageWriter..ctor(TextMessageEncoder)
   at System.ServiceModel.Channels.TextMessageEncoderFactory+TextMessageEncoder.TakeBufferedWriter()
   at System.ServiceModel.Channels.TextMessageEncoderFactory+TextMessageEncoder.WriteMessageAsync(System.ServiceModel.Channels.Message, Int32, System.ServiceModel.Channels.BufferManager, Int32)
   at System.ServiceModel.Channels.TextMessageEncoderFactory+TextMessageEncoder.WriteMessage(System.ServiceModel.Channels.Message, Int32, System.ServiceModel.Channels.BufferManager, Int32)
   at System.ServiceModel.Channels.MessageEncoder.WriteMessage(System.ServiceModel.Channels.Message, Int32, System.ServiceModel.Channels.BufferManager)
   at System.ServiceModel.Channels.BufferedMessageContent.EnsureMessageEncoded()
   at System.ServiceModel.Channels.BufferedMessageContent.TryComputeLength(Int64 ByRef)
   at System.Net.Http.HttpContent.GetComputedOrBufferLength()
   at System.Net.Http.Headers.HttpContentHeaders.get_ContentLength()
   at System.Net.Http.SocketsHttpHandler.ValidateAndNormalizeRequest(System.Net.Http.HttpRequestMessage)
   at System.Net.Http.SocketsHttpHandler.SendAsync(System.Net.Http.HttpRequestMessage, System.Threading.CancellationToken)
   at System.ServiceModel.Channels.ServiceModelHttpMessageHandler.<>n__0(System.Net.Http.HttpRequestMessage, System.Threading.CancellationToken)
   at System.ServiceModel.Channels.ServiceModelHttpMessageHandler+<SendAsync>d__40.MoveNext()
   at System.Runtime.CompilerServices.AsyncMethodBuilderCore.Start[[System.ServiceModel.Channels.ServiceModelHttpMessageHandler+<SendAsync>d__40, VMware.System.Private.ServiceModel, Version=4.5.0.0, Culture=neutral, PublicKeyToken=null]](<SendAsync>d__40 ByRef)
   at System.Runtime.CompilerServices.AsyncTaskMethodBuilder`1[[System.__Canon, System.Private.CoreLib, Version=9.0.0.0, Culture=neutral, PublicKeyToken=7cec85d7bea7798e]].Start[[System.ServiceModel.Channels.ServiceModelHttpMessageHandler+<SendAsync>d__40, VMware.System.Private.ServiceModel, Version=4.5.0.0, Culture=neutral, PublicKeyToken=null]](<SendAsync>d__40 ByRef)
   at System.ServiceModel.Channels.ServiceModelHttpMessageHandler.SendAsync(System.Net.Http.HttpRequestMessage, System.Threading.CancellationToken)
   at System.Net.Http.HttpClient+<<SendAsync>g__Core|83_0>d.MoveNext()
   at System.Runtime.CompilerServices.AsyncMethodBuilderCore.Start[[System.Net.Http.HttpClient+<<SendAsync>g__Core|83_0>d, System.Net.Http, Version=9.0.0.0, Culture=neutral, PublicKeyToken=b03f5f7f11d50a3a]](<<SendAsync>g__Core|83_0>d ByRef)
   at System.Runtime.CompilerServices.AsyncTaskMethodBuilder`1[[System.__Canon, System.Private.CoreLib, Version=9.0.0.0, Culture=neutral, PublicKeyToken=7cec85d7bea7798e]].Start[[System.Net.Http.HttpClient+<<SendAsync>g__Core|83_0>d, System.Net.Http, Version=9.0.0.0, Culture=neutral, PublicKeyToken=b03f5f7f11d50a3a]](<<SendAsync>g__Core|83_0>d ByRef)
   at System.Net.Http.HttpClient.<SendAsync>g__Core|83_0(System.Net.Http.HttpRequestMessage, System.Net.Http.HttpCompletionOption, System.Threading.CancellationTokenSource, Boolean, System.Threading.CancellationTokenSource, System.Threading.CancellationToken)
   at System.Net.Http.HttpClient.SendAsync(System.Net.Http.HttpRequestMessage, System.Net.Http.HttpCompletionOption, System.Threading.CancellationToken)
   at System.ServiceModel.Channels.HttpChannelFactory`1+HttpClientRequestChannel+HttpClientChannelAsyncRequest+<SendRequestAsync>d__13[[System.__Canon, System.Private.CoreLib, Version=9.0.0.0, Culture=neutral, PublicKeyToken=7cec85d7bea7798e]].MoveNext()
   at System.Runtime.CompilerServices.AsyncMethodBuilderCore.Start[[System.ServiceModel.Channels.HttpChannelFactory`1+HttpClientRequestChannel+HttpClientChannelAsyncRequest+<SendRequestAsync>d__13[[System.__Canon, System.Private.CoreLib, Version=9.0.0.0, Culture=neutral, PublicKeyToken=7cec85d7bea7798e]], VMware.System.Private.ServiceModel, Version=4.5.0.0, Culture=neutral, PublicKeyToken=null]](<SendRequestAsync>d__13<System.__Canon> ByRef)
   at System.Runtime.CompilerServices.AsyncTaskMethodBuilder.Start[[System.ServiceModel.Channels.HttpChannelFactory`1+HttpClientRequestChannel+HttpClientChannelAsyncRequest+<SendRequestAsync>d__13[[System.__Canon, System.Private.CoreLib, Version=9.0.0.0, Culture=neutral, PublicKeyToken=7cec85d7bea7798e]], VMware.System.Private.ServiceModel, Version=4.5.0.0, Culture=neutral, PublicKeyToken=null]](<SendRequestAsync>d__13<System.__Canon> ByRef)
   at System.ServiceModel.Channels.HttpChannelFactory`1+HttpClientRequestChannel+HttpClientChannelAsyncRequest[[System.__Canon, System.Private.CoreLib, Version=9.0.0.0, Culture=neutral, PublicKeyToken=7cec85d7bea7798e]].SendRequestAsync(System.ServiceModel.Channels.Message, System.Runtime.TimeoutHelper)
   at System.ServiceModel.Channels.RequestChannel+<RequestAsync>d__33.MoveNext()
   at System.Runtime.CompilerServices.AsyncMethodBuilderCore.Start[[System.ServiceModel.Channels.RequestChannel+<RequestAsync>d__33, VMware.System.Private.ServiceModel, Version=4.5.0.0, Culture=neutral, PublicKeyToken=null]](<RequestAsync>d__33 ByRef)
   at System.Runtime.CompilerServices.AsyncTaskMethodBuilder`1[[System.__Canon, System.Private.CoreLib, Version=9.0.0.0, Culture=neutral, PublicKeyToken=7cec85d7bea7798e]].Start[[System.ServiceModel.Channels.RequestChannel+<RequestAsync>d__33, VMware.System.Private.ServiceModel, Version=4.5.0.0, Culture=neutral, PublicKeyToken=null]](<RequestAsync>d__33 ByRef)
   at System.ServiceModel.Channels.RequestChannel.RequestAsync(System.ServiceModel.Channels.Message, System.TimeSpan)
   at System.ServiceModel.Channels.RequestChannel+<RequestAsyncInternal>d__32.MoveNext()
   at System.Runtime.CompilerServices.AsyncMethodBuilderCore.Start[[System.ServiceModel.Channels.RequestChannel+<RequestAsyncInternal>d__32, VMware.System.Private.ServiceModel, Version=4.5.0.0, Culture=neutral, PublicKeyToken=null]](<RequestAsyncInternal>d__32 ByRef)
   at System.Runtime.CompilerServices.AsyncTaskMethodBuilder`1[[System.__Canon, System.Private.CoreLib, Version=9.0.0.0, Culture=neutral, PublicKeyToken=7cec85d7bea7798e]].Start[[System.ServiceModel.Channels.RequestChannel+<RequestAsyncInternal>d__32, VMware.System.Private.ServiceModel, Version=4.5.0.0, Culture=neutral, PublicKeyToken=null]](<RequestAsyncInternal>d__32 ByRef)
   at System.ServiceModel.Channels.RequestChannel.RequestAsyncInternal(System.ServiceModel.Channels.Message, System.TimeSpan)
   at System.ServiceModel.Channels.RequestChannel.Request(System.ServiceModel.Channels.Message, System.TimeSpan)
   at System.ServiceModel.Dispatcher.RequestChannelBinder.Request(System.ServiceModel.Channels.Message, System.TimeSpan)
   at System.ServiceModel.Channels.ServiceChannel.Call(System.String, Boolean, System.ServiceModel.Dispatcher.ProxyOperationRuntime, System.Object[], System.Object[], System.TimeSpan)
   at System.ServiceModel.Channels.ServiceChannel.Call(System.String, Boolean, System.ServiceModel.Dispatcher.ProxyOperationRuntime, System.Object[], System.Object[])
   at System.ServiceModel.Channels.ServiceChannelProxy.InvokeService(System.ServiceModel.Channels.MethodCall, System.ServiceModel.Dispatcher.ProxyOperationRuntime)
   at System.ServiceModel.Channels.ServiceChannelProxy.Invoke(System.Reflection.MethodInfo, System.Object[])
   at generatedProxy_1.RetrieveServiceContent(VimApi_803.RetrieveServiceContentRequest)
   at VMware.Vim.ServiceInstance.RetrieveServiceContent()
   at VMware.Vim.VimClientImpl.Connect()
   at VMware.VimAutomation.ViCore.Impl.V1.VimClientConnection.ConnectVimClient(VMware.VimAutomation.Common.Interop.V1.Certificate.IServerCertificateValidationHandler)
   at VMware.VimAutomation.ViCore.Impl.V1.VimClientConnection.Connect(System.String, System.String ByRef, System.String, VMware.VimAutomation.Common.Interop.V1.Certificate.IServerCertificateValidationHandler)
   at VMware.VimAutomation.ViCore.Impl.V1.Service.ConnectivityServiceImpl.Reconnect(VMware.VimAutomation.ViCore.Impl.V1.AuthenticationType)
   at VMware.VimAutomation.ViCore.Impl.V1.Service.ConnectivityServiceImpl.Connect(VMware.VimAutomation.ViCore.Impl.V1.VimClientConfig, VMware.VimAutomation.ViCore.Impl.V1.AuthenticationType)
   at VMware.VimAutomation.ViCore.Impl.V1.Service.ConnectivityServiceImpl.Login(System.String, System.String, Int32, System.String, System.String, VMware.VimAutomation.Common.Interop.V1.Certificate.IServerCertificateValidationHandler)
   at VMware.VimAutomation.ViCore.Impl.V1.Service.ServerLoginHelper.DoLoginUseUserPass(System.String, System.String, Int32, VMware.VimAutomation.ViCore.Interop.V1.VIAutomation, Boolean, System.String, System.String, VMware.VimAutomation.Common.Interop.V1.Certificate.IServerCertificateValidationHandler, Boolean ByRef)
   at VMware.VimAutomation.ViCore.Impl.V1.Service.ServerLoginHelper.DoLogin(System.String, System.Nullable`1<Int32>, System.String, System.String ByRef, System.String ByRef, System.String, VMware.VimAutomation.Common.Types.V1.Authentication.SamlSecurityContext, Boolean, VMware.VimAutomation.Common.Interop.V1.Certificate.IServerCertificateValidationHandler, Boolean ByRef, VMware.VimAutomation.Sdk.Interop.V1.CredentialPromptCallback)
   at VMware.VimAutomation.ViCore.Impl.V1.Service.ClientManagerImpl.ConnectViServer(System.Collections.Generic.IList`1<System.String>, System.Nullable`1<Int32>, System.String, System.String, System.String, System.String, VMware.VimAutomation.Common.Types.V1.Authentication.SamlSecurityContext, VMware.VimAutomation.Common.Interop.V1.Certificate.IServerCertificateValidationHandler, VMware.VimAutomation.Sdk.Interop.V1.CredentialPromptCallback, VMware.VimAutomation.ViCore.Interop.V1.Service.ServerConnectedCallback)
   at VMware.VimAutomation.ViCore.Cmdlets.Commands.ConnectVIServer.ConnectInParallelThread(System.String, System.String, System.String, VMware.VimAutomation.Common.Interop.V1.Certificate.IServerCertificateValidationHandler, System.Collections.Generic.List`1<System.Exception> ByRef)
   at VMware.VimAutomation.ViCore.Cmdlets.Commands.ConnectVIServer+<>c__DisplayClass60_1.<ProcessRecordErrorHandled>b__1()
   at System.Threading.ExecutionContext.RunInternal(System.Threading.ExecutionContext, System.Threading.ContextCallback, System.Object)

As by the message "Stack overflow" i suspect some code path enters a "infinite recursion" loop. But i can't really tell.

Maybe someone can give insight?

[japod]

This might be related to the actual system locale. Switching to en_US.UTF-8 should help. In case of Windows OS, you will need to switch the whole UI session unfortunately. Please note that using en_UK.UTF-8 leads to the same issue (switching the language itself is not sufficient). You might check with the Get-Culture command, the output should be as follows:

PS> Get-Culture

LCID             Name             DisplayName
----             ----             -----------
1033             en-US            English (United States)