"Connection was Asynchronously terminated" on .connect() call. Corporate networks

classic Classic list List threaded Threaded
23 messages Options
12
Reply | Threaded
Open this post in threaded view
|

"Connection was Asynchronously terminated" on .connect() call. Corporate networks

philware
Hi,

When trying to use SwiftMQ AMQP within a corporate network with probably man-in-the-middle proxies we are finding the .connect() method false instantly with "Connection was Asynchronously terminated".

When we have a more direct link to the internet there is no issue.

Interestingly when we use the Apache QPID AMQP library, this works fine on corporate networks.

Do you have any pointers on how to configure SwiftMQ so that it will work through proxies?
We are assuming it is something to do with the certificates.

Thanks,
Phil.
Reply | Threaded
Open this post in threaded view
|

Re: "Connection was Asynchronously terminated" on .connect() call. Corporate networks

IIT Software
Administrator
So you use SSL?
Reply | Threaded
Open this post in threaded view
|

Re: "Connection was Asynchronously terminated" on .connect() call. Corporate networks

philware
The AMQP server we are talking to is the Microsoft Service Bus which uses SSL.

"amqps://myapp/queue"

We are using the -Dswiftmq.jsse.anoncipher.enabled=false parameter when starting the java application.
This works well in a simple network setup.
Reply | Threaded
Open this post in threaded view
|

Re: "Connection was Asynchronously terminated" on .connect() call. Corporate networks

IIT Software
Administrator
What is the output if you set

-Dswiftmq.amqp.frame.debug=true

?
Reply | Threaded
Open this post in threaded view
|

Re: "Connection was Asynchronously terminated" on .connect() call. Corporate networks

philware
Thanks for the tip - we'll do this soon and I can post the debug.

Regards,
Phil.
Reply | Threaded
Open this post in threaded view
|

Re: "Connection was Asynchronously terminated" on .connect() call. Corporate networks

IIT Software
Administrator
Did you test the samples as described here? Do they work with your corporate setup?

Keep in mind that SSL requires to use port 5671.
Reply | Threaded
Open this post in threaded view
|

Re: "Connection was Asynchronously terminated" on .connect() call. Corporate networks

philware
Hi,

The Qpid client works OK when the SwiftMQ client doesn't. So this is not port issue.

Having run the system with debug on we have found the following:-

After adding "-Dswiftmq.amqp.frame.debug=true -Dswiftmq.amqp.debug=true" as suggested by the debugging section on http://www.swiftmq.com/products/router/swiftlets/sys_amqp/client/index.html we can see an important difference between a working and failing example:

Working:
ConnectionDispatcher, , visit, po=[POOpen, containerId=ceeba427-2662-4f51-a83c-70bc6729a040@sjw-laptop, maxFrameSize=2147483647, maxChannel=255, idleTimeout=60000] ...
ConnectionDispatcher, , visit, po=[POOpen, containerId=ceeba427-2662-4f51-a83c-70bc6729a040@sjw-laptop, maxFrameSize=2147483647, maxChannel=255, idleTimeout=60000] done
amqp, SND[0] (size=121): [Open containerId=ceeba427-2662-4f51-a83c-70bc6729a040@sjw-laptop, hostname=neul-test-m2m.servicebus.windows.net, maxFrameSize=2147483647, channelMax=255, idleTimeOut=60000]
amqp, RCV[0] (size=71): [Open containerId=ff83c39d4cec448aa32e9034fc631ac7_G23, maxFrameSize=65536, channelMax=255, idleTimeOut=240000]
{noformat}

Failing:
ConnectionDispatcher, , visit, po=[POOpen, containerId=null, maxFrameSize=2147483647, maxChannel=255, idleTimeout=60000] ...
ConnectionDispatcher, , visit, po=[POOpen, containerId=null, maxFrameSize=2147483647, maxChannel=255, idleTimeout=60000] done
{noformat}

Notice how in the failing case that containerId is "null"

So what is containerID?
If we go and lookup the AMQP for the open frame we can see that it provides a bunch of parameters, one of which is container-id - http://docs.oasis-open.org/amqp/core/v1.0/os/amqp-core-transport-v1.0-os.html#type-open
The description is:
container-id the id of the source container mandatory string
and in the failing case we set it to null, which I assume means that it does not get transmitted.
This looks like a bug in SwiftMQ to me, as the com.swiftmq.amqp.v100.client.Connection documentation says that it is set automatically if not specified.

With luck the com.swiftmq.amqp.v100.client.connection class contains a method called setContainerId - http://www.swiftmq.com/products/router/swiftlets/sys_amqp/client/javadoc/com/swiftmq/amqp/v100/client/Connection.html#setContainerId(java.lang.String).
So the work around is to call setContainerId with a random number (lets call it a uuid...) everytime we create a SwiftMQ connection class.

This has now FIXED my issue.
Reply | Threaded
Open this post in threaded view
|

Re: "Connection was Asynchronously terminated" on .connect() call. Corporate networks

IIT Software
Administrator
I disagree. The SwiftMQ AMQP client sets the container id within the constructor of the Connection object. It can only be null if you overwrite it with null. Here is the output from samples/amqp/SenderNontransacted:

amqp, SND[0] (size=99): [Open containerId=57f63661-cc6e-4e6a-a7c0-d94d6584c9e9@imac-home.local, hostname=localhost, maxFrameSize=2147483647, channelMax=255, idleTimeOut=4294967295]

So this works out of the box.

Reply | Threaded
Open this post in threaded view
|

Re: "Connection was Asynchronously terminated" on .connect() call. Corporate networks

philware
I am not sure why you have shown your debug output running on a system which doesn't cause this exception to be thrown on .connect(). Obviously we need to grab the debug output on the non-working system. This debug output shows that ContainerID is null.

Here is the code (This is virtually identical to your test code)

                ctx = new AMQPContext(AMQPContext.CLIENT);
                String host = String.format("%s.servicebus.windows.net", connectionInfo.getNamespace());
                connection = new Connection(ctx, host, 5671, connectionInfo.getUsername(), connectionInfo.getPassword());

                connection.setIdleTimeout(60000);
                connection.setExceptionListener(this);
                connection.setSocketFactory(new JSSESocketFactory());
               
                try {
                        connection.connect();
                } catch (Exception ex) {
                        logger.error(ex);              // <-- Connection was asynchronously terminated
                }

As you can see we are NOT overwriting the ContainerID value.

This bug only happens in corporate networks, where the Apache QPID AMPQ library works fine with no problems.

By specifically setting the ContainerID the SwiftMQ client now works at the couple of sites where we have this issue.


Regards,
Phil.
Reply | Threaded
Open this post in threaded view
|

Re: "Connection was Asynchronously terminated" on .connect() call. Corporate networks

IIT Software
Administrator
Sorry, but we tested ServiceBus extensively and have created a How To document here. Microsoft even used our test suite, based on our AMQP 1.0 client, to test their implementation.

It really doesn't matter to which broker the SwiftMQ client is connected to to see what kind of value the container id has that the client sends in an open frame. This is always the same because the container id is set in the constructor of the connection. You can proof that if you print connection.getContainerId() right after calling the constructor.

Your debug output doesn't show the AMQP frames but the internal debug output. Please set only -Dswiftmq.amqp.frame.debug=true and let's see how the open frame looks like.
Reply | Threaded
Open this post in threaded view
|

Re: "Connection was Asynchronously terminated" on .connect() call. Corporate networks

philware
This post was updated on .
(We are using version 9.5.0)

Here is the output of the test with just amqp.frame.debug=true

bsc@NN2510-001275:~/swiftmq_9_5_0_client/samples/amqp$ java -cp .:../../jars/swiftmq.jar:../../jars/amqp.jar -Dswiftmq.jsse.anoncipher.enabled=false -Dswiftmq.amqp.frame.debug=true -Dswiftmq.amqp.debug=false  SenderNonTransacted neul-test-m2m.servicebus.windows.net 5671 Upstream_Bsci_10 10 EXACTLY_ONCE flase owner "***************"

Host        : neul-test-m2m.servicebus.windows.net
Port        : 5671
Target      : Upstream_Bsci_10
Number Msgs : 10
QoS         : EXACTLY_ONCE
Auth as Anon: false
User        : owner
Password    : **************

Using SSL on port 5671
amqp, SND: [ProtocolHeader, name=AMQP, id=3, major=1, minor=0, revision=0]
amqp, RCV: [ProtocolHeader, name=AMQP, id=3, major=1, minor=0, revision=0]
amqp, RCV[0] (size=39): [SaslMechanisms saslServerMechanisms=[PLAIN, EXTERNAL]]
amqp, SND[0] (size=119): [SaslInit mechanism=PLAIN, initialResponse=006F776E657200396330482F6A4F33384169566A6F555063394531316466466B5150524E5A714E4F777664503632465941733D, hostname=neul-test-m2m.servicebus.windows.net]
amqp, RCV[0] (size=26): [SaslOutcome mycode=0, additionalData=57656C636F6D6521]
amqp, SND: [ProtocolHeader, name=AMQP, id=0, major=1, minor=0, revision=0]
amqp, RCV: [ProtocolHeader, name=AMQP, id=0, major=1, minor=0, revision=0]
java.io.IOException: Connection was asynchronously closed
        at com.swiftmq.amqp.v100.client.Connection.connect(Unknown Source)
        at SenderNonTransacted.main(SenderNonTransacted.java:128)


Here is the output of the test with both debug's turned on:-

bsc@NN2510-001275:~/swiftmq_9_5_0_client/samples/amqp$ java -cp .:../../jars/swiftmq.jar:../../jars/amqp.jar -Dswiftmq.jsse.anoncipher.enabled=false -Dswiftmq.amqp.frame.debug=true -Dswiftmq.amqp.debug=true SenderNonTransacted neul-test-m2m.servicebus.windows.net 5671 Upstream_Bsci_10 10 EXACTLY_ONCE flase owner "**************"

Host        : neul-test-m2m.servicebus.windows.net
Port        : 5671
Target      : Upstream_Bsci_10
Number Msgs : 10
QoS         : EXACTLY_ONCE
Auth as Anon: false
User        : owner
Password    : **************

Using SSL on port 5671
ConnectionDispatcher, , visit, po=[POProtocolRequest, header=[ProtocolHeader, name=AMQP, id=3, major=1, minor=0, revision=0]] ...
ConnectionDispatcher, , visit, po=[POProtocolRequest, header=[ProtocolHeader, name=AMQP, id=3, major=1, minor=0, revision=0]] done
amqp, SND: [ProtocolHeader, name=AMQP, id=3, major=1, minor=0, revision=0]
amqp, RCV: [ProtocolHeader, name=AMQP, id=3, major=1, minor=0, revision=0]
ConnectionDispatcher, , visit, po=[POProtocolResponse, header=[ProtocolHeader, name=AMQP, id=3, major=1, minor=0, revision=0]] ...
ConnectionDispatcher, , visit, po=[POProtocolResponse, header=[ProtocolHeader, name=AMQP, id=3, major=1, minor=0, revision=0]] done
ConnectionDispatcher, , visit, po=[POAuthenticate, mechanism=PLAIN, username=owner, password=**************] ...
ConnectionDispatcher, , visit, po=[POAuthenticate, mechanism=PLAIN, username=owner, password=**************] done
amqp, RCV[0] (size=39): [SaslMechanisms saslServerMechanisms=[PLAIN, EXTERNAL]]
ConnectionDispatcher, , visit, po=[POConnectionFrameReceived, frame=[SaslMechanisms saslServerMechanisms=[PLAIN, EXTERNAL]], sassl=true] ...
ConnectionVisitor, , visit=[SaslMechanisms saslServerMechanisms=[PLAIN, EXTERNAL]]
ConnectionDispatcher, , visit, po=[POConnectionFrameReceived, frame=[SaslMechanisms saslServerMechanisms=[PLAIN, EXTERNAL]], sassl=true] done
amqp, SND[0] (size=119): [SaslInit mechanism=PLAIN, initialResponse=006F776E657200396330482F6A4F33384169566A6F555063394531316466466B5150524E5A714E4F777664503632465941733D, hostname=neul-test-m2m.servicebus.windows.net]
amqp, RCV[0] (size=26): [SaslOutcome mycode=0, additionalData=57656C636F6D6521]
ConnectionDispatcher, , visit, po=[POConnectionFrameReceived, frame=[SaslOutcome mycode=0, additionalData=57656C636F6D6521], sassl=true] ...
ConnectionVisitor, , visit=[SaslOutcome mycode=0, additionalData=57656C636F6D6521]
ConnectionDispatcher, , visit, po=[POConnectionFrameReceived, frame=[SaslOutcome mycode=0, additionalData=57656C636F6D6521], sassl=true] done
ConnectionDispatcher, , visit, po=[POProtocolRequest, header=[ProtocolHeader, name=AMQP, id=0, major=1, minor=0, revision=0]] ...
ConnectionDispatcher, , visit, po=[POProtocolRequest, header=[ProtocolHeader, name=AMQP, id=0, major=1, minor=0, revision=0]] done
amqp, SND: [ProtocolHeader, name=AMQP, id=0, major=1, minor=0, revision=0]
amqp, RCV: [ProtocolHeader, name=AMQP, id=0, major=1, minor=0, revision=0]
ConnectionDispatcher, , visit, po=[POProtocolResponse, header=[ProtocolHeader, name=AMQP, id=0, major=1, minor=0, revision=0]] ...
ConnectionDispatcher, , visit, po=[POProtocolResponse, header=[ProtocolHeader, name=AMQP, id=0, major=1, minor=0, revision=0]] done
ConnectionDispatcher, , visit, po=[POOpen, containerId=null, maxFrameSize=2147483647, maxChannel=255, idleTimeout=9223372036854775807] ...
ConnectionDispatcher, , close ...
ConnectionDispatcher, , visit, po=[POOpen, containerId=null, maxFrameSize=2147483647, maxChannel=255, idleTimeout=9223372036854775807] done
ConnectionDispatcher, , visit, po=[POConnectionClose] ...
ConnectionDispatcher, , close ...
ConnectionDispatcher, , close in progress, return
ConnectionDispatcher, , visit, po=[POConnectionClose] done
ConnectionDispatcher, , close done
java.io.IOException: Connection was asynchronously closed
        at com.swiftmq.amqp.v100.client.Connection.connect(Unknown Source)
        at SenderNonTransacted.main(SenderNonTransacted.java:128)


Thank you for continuing to look at this,
Phil.
Reply | Threaded
Open this post in threaded view
|

Re: "Connection was Asynchronously terminated" on .connect() call. Corporate networks

philware
In reply to this post by IIT Software
Here is the test application working  on another network:-
(Note there have been no code changes to the SenderNonTransacted class)

bsc@NN2510-000895:~/swiftmq_9_5_0_client/samples/amqp$ java -cp .:../../jars/swiftmq.jar:../../jars/amqp.jar -Dswiftmq.jsse.anoncipher.enabled=false -Dswiftmq.amqp.frame.debug=true -Dswiftmq.amqp.debug=true SenderNonTransacted neul-test-m2m.servicebus.windows.net 5671 Upstream_Bsci_10 10 EXACTLY_ONCE flase owner "**********************"

Host        : neul-test-m2m.servicebus.windows.net
Port        : 5671
Target      : Upstream_Bsci_10
Number Msgs : 10
QoS         : EXACTLY_ONCE
Auth as Anon: false
User        : owner
Password    : **********************

Using SSL on port 5671
ConnectionDispatcher, , visit, po=[POProtocolRequest, header=[ProtocolHeader, name=AMQP, id=3, major=1, minor=0, revision=0]] ...
amqp, SND: [ProtocolHeader, name=AMQP, id=3, major=1, minor=0, revision=0]
ConnectionDispatcher, , visit, po=[POProtocolRequest, header=[ProtocolHeader, name=AMQP, id=3, major=1, minor=0, revision=0]] done
amqp, RCV: [ProtocolHeader, name=AMQP, id=3, major=1, minor=0, revision=0]
ConnectionDispatcher, , visit, po=[POProtocolResponse, header=[ProtocolHeader, name=AMQP, id=3, major=1, minor=0, revision=0]] ...
ConnectionDispatcher, , visit, po=[POProtocolResponse, header=[ProtocolHeader, name=AMQP, id=3, major=1, minor=0, revision=0]] done
ConnectionDispatcher, , visit, po=[POAuthenticate, mechanism=PLAIN, username=owner, password=**************] ...
ConnectionDispatcher, , visit, po=[POAuthenticate, mechanism=PLAIN, username=owner, password=**************] done
amqp, RCV[0] (size=39): [SaslMechanisms saslServerMechanisms=[PLAIN, EXTERNAL]]
ConnectionDispatcher, , visit, po=[POConnectionFrameReceived, frame=[SaslMechanisms saslServerMechanisms=[PLAIN, EXTERNAL]], sassl=true] ...
ConnectionVisitor, , visit=[SaslMechanisms saslServerMechanisms=[PLAIN, EXTERNAL]]
ConnectionDispatcher, , visit, po=[POConnectionFrameReceived, frame=[SaslMechanisms saslServerMechanisms=[PLAIN, EXTERNAL]], sassl=true] done
amqp, SND[0] (size=119): [SaslInit mechanism=PLAIN, initialResponse=006F776E657200396330482F6A4F33384169566A6F555063394531316466466B5150524E5A714E4F777664503632465941733D, hostname=neul-test-m2m.servicebus.windows.net]
amqp, RCV[0] (size=26): [SaslOutcome mycode=0, additionalData=57656C636F6D6521]
ConnectionDispatcher, , visit, po=[POConnectionFrameReceived, frame=[SaslOutcome mycode=0, additionalData=57656C636F6D6521], sassl=true] ...
ConnectionVisitor, , visit=[SaslOutcome mycode=0, additionalData=57656C636F6D6521]
ConnectionDispatcher, , visit, po=[POConnectionFrameReceived, frame=[SaslOutcome mycode=0, additionalData=57656C636F6D6521], sassl=true] done
ConnectionDispatcher, , visit, po=[POProtocolRequest, header=[ProtocolHeader, name=AMQP, id=0, major=1, minor=0, revision=0]] ...
ConnectionDispatcher, , visit, po=[POProtocolRequest, header=[ProtocolHeader, name=AMQP, id=0, major=1, minor=0, revision=0]] done
amqp, SND: [ProtocolHeader, name=AMQP, id=0, major=1, minor=0, revision=0]
amqp, RCV: [ProtocolHeader, name=AMQP, id=0, major=1, minor=0, revision=0]
ConnectionDispatcher, , visit, po=[POProtocolResponse, header=[ProtocolHeader, name=AMQP, id=0, major=1, minor=0, revision=0]] ...
ConnectionDispatcher, , visit, po=[POProtocolResponse, header=[ProtocolHeader, name=AMQP, id=0, major=1, minor=0, revision=0]] done
ConnectionDispatcher, , visit, po=[POOpen, containerId=8d5297f8-b48d-4e2a-88cf-36e58c374542@NN2510-000895, maxFrameSize=2147483647, maxChannel=255, idleTimeout=9223372036854775807] ...
amqp, SND[0] (size=124): [Open containerId=8d5297f8-b48d-4e2a-88cf-36e58c374542@NN2510-000895, hostname=neul-test-m2m.servicebus.windows.net, maxFrameSize=2147483647, channelMax=255, idleTimeOut=4294967295]
ConnectionDispatcher, , visit, po=[POOpen, containerId=8d5297f8-b48d-4e2a-88cf-36e58c374542@NN2510-000895, maxFrameSize=2147483647, maxChannel=255, idleTimeout=9223372036854775807] done
amqp, RCV[0] (size=71): [Open containerId=2a82fe9384aa4d709d9d24b209dca1ec_G22, maxFrameSize=65536, channelMax=255, idleTimeOut=240000]
ConnectionDispatcher, , visit, po=[POConnectionFrameReceived, frame=[Open containerId=2a82fe9384aa4d709d9d24b209dca1ec_G22, maxFrameSize=65536, channelMax=255, idleTimeOut=240000], sassl=false] ...
ConnectionVisitor, , visit=[Open containerId=2a82fe9384aa4d709d9d24b209dca1ec_G22, maxFrameSize=65536, channelMax=255, idleTimeOut=240000]
ConnectionDispatcher, , visit, po=[POConnectionFrameReceived, frame=[Open containerId=2a82fe9384aa4d709d9d24b209dca1ec_G22, maxFrameSize=65536, channelMax=255, idleTimeOut=240000], sassl=false] done
SessionDispatcher, channel=0, , visit, po=[POBegin] ...
amqp, SND[0] (size=42): [Begin nextOutgoingId=1, incomingWindow=50, outgoingWindow=50, handleMax=2147483647]
SessionDispatcher, channel=0, , visit, po=[POBegin] done
amqp, RCV[0] (size=28): [Begin remoteChannel=0, nextOutgoingId=1, incomingWindow=50, outgoingWindow=50, handleMax=7]
ConnectionDispatcher, , visit, po=[POConnectionFrameReceived, frame=[Begin remoteChannel=0, nextOutgoingId=1, incomingWindow=50, outgoingWindow=50, handleMax=7], sassl=false] ...
ConnectionVisitor, , visit=[Begin remoteChannel=0, nextOutgoingId=1, incomingWindow=50, outgoingWindow=50, handleMax=7]
SessionDispatcher, channel=0, , visit, po=[POConnectionFrameReceived, frame=[Begin remoteChannel=0, nextOutgoingId=1, incomingWindow=50, outgoingWindow=50, handleMax=7]] ...
SessionDispatcherFrameVisitor, , visit=[Begin remoteChannel=0, nextOutgoingId=1, incomingWindow=50, outgoingWindow=50, handleMax=7]
ConnectionDispatcher, , visit, po=[POConnectionFrameReceived, frame=[Begin remoteChannel=0, nextOutgoingId=1, incomingWindow=50, outgoingWindow=50, handleMax=7], sassl=false] done
SessionDispatcher, channel=0, , visit, po=[POConnectionFrameReceived, frame=[Begin remoteChannel=0, nextOutgoingId=1, incomingWindow=50, outgoingWindow=50, handleMax=7]] done
SessionDispatcher, channel=0, , visit, po=[POAttachProducer, target=Upstream_Bsci_10, link=null, qoS=2, deliveryMemory=com.swiftmq.amqp.v100.client.DefaultDeliveryMemory@13313b1] ...
amqp, SND[0] (size=188): [Attach name=328538763985157080/0/Upstream_Bsci_10/0, handle=0, role=FALSE, sndSettleMode=2, rcvSettleMode=1, source=[Source address=328538763985157080/0/Upstream_Bsci_10/0, durable=0, expiryPolicy=link-detach, timeout=0, dynamic=FALSE], target=[Target address=Upstream_Bsci_10, durable=0, expiryPolicy=link-detach, timeout=0, dynamic=FALSE], incompleteUnsettled=FALSE, initialDeliveryCount=0]
SessionDispatcher, channel=0, , visit, po=[POAttachProducer, target=Upstream_Bsci_10, link=com.swiftmq.amqp.v100.client.Producer@1a9447c, qoS=2, deliveryMemory=com.swiftmq.amqp.v100.client.DefaultDeliveryMemory@13313b1] done
amqp, RCV[0] (size=277): [Attach name=328538763985157080/0/Upstream_Bsci_10/0, handle=0, role=TRUE, sndSettleMode=2, rcvSettleMode=1, source=[Source address=328538763985157080/0/Upstream_Bsci_10/0, durable=0, expiryPolicy=link-detach, timeout=0, dynamic=FALSE], target=[Target address=Upstream_Bsci_10, durable=0, expiryPolicy=link-detach, timeout=0, dynamic=FALSE], incompleteUnsettled=FALSE, maxMessageSize=262144, properties=[com.microsoft:tracking-id=2a82fe9384aa4d709d9d24b209dca1ec_G22_B21;16312:9956:9957]]
SessionDispatcher, channel=0, , visit, po=[POConnectionFrameReceived, frame=[Attach name=328538763985157080/0/Upstream_Bsci_10/0, handle=0, role=TRUE, sndSettleMode=2, rcvSettleMode=1, source=[Source address=328538763985157080/0/Upstream_Bsci_10/0, durable=0, expiryPolicy=link-detach, timeout=0, dynamic=FALSE], target=[Target address=Upstream_Bsci_10, durable=0, expiryPolicy=link-detach, timeout=0, dynamic=FALSE], incompleteUnsettled=FALSE, maxMessageSize=262144, properties=[com.microsoft:tracking-id=2a82fe9384aa4d709d9d24b209dca1ec_G22_B21;16312:9956:9957]]] ...
SessionDispatcherFrameVisitor, , visit=[Attach name=328538763985157080/0/Upstream_Bsci_10/0, handle=0, role=TRUE, sndSettleMode=2, rcvSettleMode=1, source=[Source address=328538763985157080/0/Upstream_Bsci_10/0, durable=0, expiryPolicy=link-detach, timeout=0, dynamic=FALSE], target=[Target address=Upstream_Bsci_10, durable=0, expiryPolicy=link-detach, timeout=0, dynamic=FALSE], incompleteUnsettled=FALSE, maxMessageSize=262144, properties=[com.microsoft:tracking-id=2a82fe9384aa4d709d9d24b209dca1ec_G22_B21;16312:9956:9957]]
SessionDispatcher, channel=0, , visit, po=[POConnectionFrameReceived, frame=[Attach name=328538763985157080/0/Upstream_Bsci_10/0, handle=0, role=TRUE, sndSettleMode=2, rcvSettleMode=1, source=[Source address=328538763985157080/0/Upstream_Bsci_10/0, durable=0, expiryPolicy=link-detach, timeout=0, dynamic=FALSE], target=[Target address=Upstream_Bsci_10, durable=0, expiryPolicy=link-detach, timeout=0, dynamic=FALSE], incompleteUnsettled=FALSE, maxMessageSize=262144, properties=[com.microsoft:tracking-id=2a82fe9384aa4d709d9d24b209dca1ec_G22_B21;16312:9956:9957]]] done
amqp, RCV[0] (size=30): [Flow nextIncomingId=1, incomingWindow=50, nextOutgoingId=1, outgoingWindow=50, handle=0, deliveryCount=0, linkCredit=50, available=0, drain=FALSE, echo=FALSE]
SessionDispatcher, channel=0, , visit, po=[POConnectionFrameReceived, frame=[Flow nextIncomingId=1, incomingWindow=50, nextOutgoingId=1, outgoingWindow=50, handle=0, deliveryCount=0, linkCredit=50, available=0, drain=FALSE, echo=FALSE]] ...
SessionDispatcherFrameVisitor, , visit=[Flow nextIncomingId=1, incomingWindow=50, nextOutgoingId=1, outgoingWindow=50, handle=0, deliveryCount=0, linkCredit=50, available=0, drain=FALSE, echo=FALSE]
SessionDispatcherFrameVisitor, , visit=[Flow nextIncomingId=1, incomingWindow=50, nextOutgoingId=1, outgoingWindow=50, handle=0, deliveryCount=0, linkCredit=50, available=0, drain=FALSE, echo=FALSE], old remoteIncomingWindow=50, nextIncomingId=1, nextOutgoingId=1
SessionDispatcherFrameVisitor, , visit=[Flow nextIncomingId=1, incomingWindow=50, nextOutgoingId=1, outgoingWindow=50, handle=0, deliveryCount=0, linkCredit=50, available=0, drain=FALSE, echo=FALSE], new remoteIncomingWindow=50
SessionDispatcher, channel=0, , visit, po=[POConnectionFrameReceived, frame=[Flow nextIncomingId=1, incomingWindow=50, nextOutgoingId=1, outgoingWindow=50, handle=0, deliveryCount=0, linkCredit=50, available=0, drain=FALSE, echo=FALSE]] done
Sending Message #1
SessionDispatcher, channel=0, , visit, po=[POSendMessage, producer=com.swiftmq.amqp.v100.client.Producer@1a9447c, message=[AMQPMessage, header=[Header durable=TRUE, priority=5, firstAcquirer=FALSE, deliveryCount=0], properties=[Properties messageId=328538763985157080/1/0, userId=6F776E6572, to=Upstream_Bsci_10], amqpValue=[AmqpValue Message #1]], txnId=null, deliveryState=null, deliveryTag=null, recovery=false] ...
SessionDispatcher, channel=0, , visit, po=[POSendMessage, producer=com.swiftmq.amqp.v100.client.Producer@1a9447c, message=[AMQPMessage, header=[Header durable=TRUE, priority=5, firstAcquirer=FALSE, deliveryCount=0], properties=[Properties messageId=328538763985157080/1/0, userId=6F776E6572, to=Upstream_Bsci_10], amqpValue=[AmqpValue Message #1]], txnId=null, deliveryState=null, deliveryTag=null, recovery=false], linkCredit=50
SessionDispatcher, channel=0, , doSend, po=[POSendMessage, producer=com.swiftmq.amqp.v100.client.Producer@1a9447c, message=[AMQPMessage, header=[Header durable=TRUE, priority=5, firstAcquirer=FALSE, deliveryCount=0], properties=[Properties messageId=328538763985157080/1/0, userId=6F776E6572, to=Upstream_Bsci_10], amqpValue=[AmqpValue Message #1]], txnId=null, deliveryState=null, deliveryTag=null, recovery=false], dataLength=103
SessionDispatcher, channel=0, , doSend, remoteIncomingWindows=50, outgoingWindow=50, sending message, wasFirstPacket=true, maxSize=65536, packetSize=103, predictedNumberPackets=2, currentPacket=1, hasMore=false
amqp, SND[0] (size=148): [Transfer handle=0, deliveryId=2, deliveryTag=0000000000000001, messageFormat=0, settled=FALSE, more=FALSE, resume=FALSE, aborted=FALSE, batchable=FALSE, body=[0, 2, 0000000000000001, 0, FALSE, FALSE, NULL, NULL, FALSE, FALSE, FALSE]]
SessionDispatcher, channel=0, , visit, po=[POSendMessage, producer=com.swiftmq.amqp.v100.client.Producer@1a9447c, message=[AMQPMessage, header=[Header durable=TRUE, priority=5, firstAcquirer=FALSE, deliveryCount=0], properties=[Properties messageId=328538763985157080/1/0, userId=6F776E6572, to=Upstream_Bsci_10], amqpValue=[AmqpValue Message #1]], txnId=null, deliveryState=null, deliveryTag=null, recovery=false] done
Sending Message #2
SessionDispatcher, channel=0, , visit, po=[POSendMessage, producer=com.swiftmq.amqp.v100.client.Producer@1a9447c, message=[AMQPMessage, header=[Header durable=TRUE, priority=5, firstAcquirer=FALSE, deliveryCount=0], properties=[Properties messageId=328538763985157080/1/1, userId=6F776E6572, to=Upstream_Bsci_10], amqpValue=[AmqpValue Message #2]], txnId=null, deliveryState=null, deliveryTag=null, recovery=false] ...
SessionDispatcher, channel=0, , visit, po=[POSendMessage, producer=com.swiftmq.amqp.v100.client.Producer@1a9447c, message=[AMQPMessage, header=[Header durable=TRUE, priority=5, firstAcquirer=FALSE, deliveryCount=0], properties=[Properties messageId=328538763985157080/1/1, userId=6F776E6572, to=Upstream_Bsci_10], amqpValue=[AmqpValue Message #2]], txnId=null, deliveryState=null, deliveryTag=null, recovery=false], linkCredit=49
SessionDispatcher, channel=0, , doSend, po=[POSendMessage, producer=com.swiftmq.amqp.v100.client.Producer@1a9447c, message=[AMQPMessage, header=[Header durable=TRUE, priority=5, firstAcquirer=FALSE, deliveryCount=0], properties=[Properties messageId=328538763985157080/1/1, userId=6F776E6572, to=Upstream_Bsci_10], amqpValue=[AmqpValue Message #2]], txnId=null, deliveryState=null, deliveryTag=null, recovery=false], dataLength=103
SessionDispatcher, channel=0, , doSend, remoteIncomingWindows=49, outgoingWindow=49, sending message, wasFirstPacket=true, maxSize=65536, packetSize=103, predictedNumberPackets=2, currentPacket=1, hasMore=false
amqp, SND[0] (size=148): [Transfer handle=0, deliveryId=3, deliveryTag=0000000000000002, messageFormat=0, settled=FALSE, more=FALSE, resume=FALSE, aborted=FALSE, batchable=FALSE, body=[0, 3, 0000000000000002, 0, FALSE, FALSE, NULL, NULL, FALSE, FALSE, FALSE]]
Sending Message #3
SessionDispatcher, channel=0, , visit, po=[POSendMessage, producer=com.swiftmq.amqp.v100.client.Producer@1a9447c, message=[AMQPMessage, header=[Header durable=TRUE, priority=5, firstAcquirer=FALSE, deliveryCount=0], properties=[Properties messageId=328538763985157080/1/1, userId=6F776E6572, to=Upstream_Bsci_10], amqpValue=[AmqpValue Message #2]], txnId=null, deliveryState=null, deliveryTag=null, recovery=false] done
SessionDispatcher, channel=0, , visit, po=[POSendMessage, producer=com.swiftmq.amqp.v100.client.Producer@1a9447c, message=[AMQPMessage, header=[Header durable=TRUE, priority=5, firstAcquirer=FALSE, deliveryCount=0], properties=[Properties messageId=328538763985157080/1/2, userId=6F776E6572, to=Upstream_Bsci_10], amqpValue=[AmqpValue Message #3]], txnId=null, deliveryState=null, deliveryTag=null, recovery=false] ...
SessionDispatcher, channel=0, , visit, po=[POSendMessage, producer=com.swiftmq.amqp.v100.client.Producer@1a9447c, message=[AMQPMessage, header=[Header durable=TRUE, priority=5, firstAcquirer=FALSE, deliveryCount=0], properties=[Properties messageId=328538763985157080/1/2, userId=6F776E6572, to=Upstream_Bsci_10], amqpValue=[AmqpValue Message #3]], txnId=null, deliveryState=null, deliveryTag=null, recovery=false], linkCredit=48
SessionDispatcher, channel=0, , doSend, po=[POSendMessage, producer=com.swiftmq.amqp.v100.client.Producer@1a9447c, message=[AMQPMessage, header=[Header durable=TRUE, priority=5, firstAcquirer=FALSE, deliveryCount=0], properties=[Properties messageId=328538763985157080/1/2, userId=6F776E6572, to=Upstream_Bsci_10], amqpValue=[AmqpValue Message #3]], txnId=null, deliveryState=null, deliveryTag=null, recovery=false], dataLength=103
SessionDispatcher, channel=0, , doSend, remoteIncomingWindows=48, outgoingWindow=48, sending message, wasFirstPacket=true, maxSize=65536, packetSize=103, predictedNumberPackets=2, currentPacket=1, hasMore=false
amqp, SND[0] (size=148): [Transfer handle=0, deliveryId=4, deliveryTag=0000000000000003, messageFormat=0, settled=FALSE, more=FALSE, resume=FALSE, aborted=FALSE, batchable=FALSE, body=[0, 4, 0000000000000003, 0, FALSE, FALSE, NULL, NULL, FALSE, FALSE, FALSE]]
Sending Message #4
SessionDispatcher, channel=0, , visit, po=[POSendMessage, producer=com.swiftmq.amqp.v100.client.Producer@1a9447c, message=[AMQPMessage, header=[Header durable=TRUE, priority=5, firstAcquirer=FALSE, deliveryCount=0], properties=[Properties messageId=328538763985157080/1/2, userId=6F776E6572, to=Upstream_Bsci_10], amqpValue=[AmqpValue Message #3]], txnId=null, deliveryState=null, deliveryTag=null, recovery=false] done
SessionDispatcher, channel=0, , visit, po=[POSendMessage, producer=com.swiftmq.amqp.v100.client.Producer@1a9447c, message=[AMQPMessage, header=[Header durable=TRUE, priority=5, firstAcquirer=FALSE, deliveryCount=0], properties=[Properties messageId=328538763985157080/1/3, userId=6F776E6572, to=Upstream_Bsci_10], amqpValue=[AmqpValue Message #4]], txnId=null, deliveryState=null, deliveryTag=null, recovery=false] ...
SessionDispatcher, channel=0, , visit, po=[POSendMessage, producer=com.swiftmq.amqp.v100.client.Producer@1a9447c, message=[AMQPMessage, header=[Header durable=TRUE, priority=5, firstAcquirer=FALSE, deliveryCount=0], properties=[Properties messageId=328538763985157080/1/3, userId=6F776E6572, to=Upstream_Bsci_10], amqpValue=[AmqpValue Message #4]], txnId=null, deliveryState=null, deliveryTag=null, recovery=false], linkCredit=47
SessionDispatcher, channel=0, , doSend, po=[POSendMessage, producer=com.swiftmq.amqp.v100.client.Producer@1a9447c, message=[AMQPMessage, header=[Header durable=TRUE, priority=5, firstAcquirer=FALSE, deliveryCount=0], properties=[Properties messageId=328538763985157080/1/3, userId=6F776E6572, to=Upstream_Bsci_10], amqpValue=[AmqpValue Message #4]], txnId=null, deliveryState=null, deliveryTag=null, recovery=false], dataLength=103
SessionDispatcher, channel=0, , doSend, remoteIncomingWindows=47, outgoingWindow=47, sending message, wasFirstPacket=true, maxSize=65536, packetSize=103, predictedNumberPackets=2, currentPacket=1, hasMore=false
amqp, SND[0] (size=148): [Transfer handle=0, deliveryId=5, deliveryTag=0000000000000004, messageFormat=0, settled=FALSE, more=FALSE, resume=FALSE, aborted=FALSE, batchable=FALSE, body=[0, 5, 0000000000000004, 0, FALSE, FALSE, NULL, NULL, FALSE, FALSE, FALSE]]
Sending Message #5
SessionDispatcher, channel=0, , visit, po=[POSendMessage, producer=com.swiftmq.amqp.v100.client.Producer@1a9447c, message=[AMQPMessage, header=[Header durable=TRUE, priority=5, firstAcquirer=FALSE, deliveryCount=0], properties=[Properties messageId=328538763985157080/1/3, userId=6F776E6572, to=Upstream_Bsci_10], amqpValue=[AmqpValue Message #4]], txnId=null, deliveryState=null, deliveryTag=null, recovery=false] done
SessionDispatcher, channel=0, , visit, po=[POSendMessage, producer=com.swiftmq.amqp.v100.client.Producer@1a9447c, message=[AMQPMessage, header=[Header durable=TRUE, priority=5, firstAcquirer=FALSE, deliveryCount=0], properties=[Properties messageId=328538763985157080/1/4, userId=6F776E6572, to=Upstream_Bsci_10], amqpValue=[AmqpValue Message #5]], txnId=null, deliveryState=null, deliveryTag=null, recovery=false] ...
SessionDispatcher, channel=0, , visit, po=[POSendMessage, producer=com.swiftmq.amqp.v100.client.Producer@1a9447c, message=[AMQPMessage, header=[Header durable=TRUE, priority=5, firstAcquirer=FALSE, deliveryCount=0], properties=[Properties messageId=328538763985157080/1/4, userId=6F776E6572, to=Upstream_Bsci_10], amqpValue=[AmqpValue Message #5]], txnId=null, deliveryState=null, deliveryTag=null, recovery=false], linkCredit=46
SessionDispatcher, channel=0, , doSend, po=[POSendMessage, producer=com.swiftmq.amqp.v100.client.Producer@1a9447c, message=[AMQPMessage, header=[Header durable=TRUE, priority=5, firstAcquirer=FALSE, deliveryCount=0], properties=[Properties messageId=328538763985157080/1/4, userId=6F776E6572, to=Upstream_Bsci_10], amqpValue=[AmqpValue Message #5]], txnId=null, deliveryState=null, deliveryTag=null, recovery=false], dataLength=103
SessionDispatcher, channel=0, , doSend, remoteIncomingWindows=46, outgoingWindow=46, sending message, wasFirstPacket=true, maxSize=65536, packetSize=103, predictedNumberPackets=2, currentPacket=1, hasMore=false
amqp, SND[0] (size=148): [Transfer handle=0, deliveryId=6, deliveryTag=0000000000000005, messageFormat=0, settled=FALSE, more=FALSE, resume=FALSE, aborted=FALSE, batchable=FALSE, body=[0, 6, 0000000000000005, 0, FALSE, FALSE, NULL, NULL, FALSE, FALSE, FALSE]]
Sending Message #6
SessionDispatcher, channel=0, , visit, po=[POSendMessage, producer=com.swiftmq.amqp.v100.client.Producer@1a9447c, message=[AMQPMessage, header=[Header durable=TRUE, priority=5, firstAcquirer=FALSE, deliveryCount=0], properties=[Properties messageId=328538763985157080/1/4, userId=6F776E6572, to=Upstream_Bsci_10], amqpValue=[AmqpValue Message #5]], txnId=null, deliveryState=null, deliveryTag=null, recovery=false] done
SessionDispatcher, channel=0, , visit, po=[POSendMessage, producer=com.swiftmq.amqp.v100.client.Producer@1a9447c, message=[AMQPMessage, header=[Header durable=TRUE, priority=5, firstAcquirer=FALSE, deliveryCount=0], properties=[Properties messageId=328538763985157080/1/5, userId=6F776E6572, to=Upstream_Bsci_10], amqpValue=[AmqpValue Message #6]], txnId=null, deliveryState=null, deliveryTag=null, recovery=false] ...
SessionDispatcher, channel=0, , visit, po=[POSendMessage, producer=com.swiftmq.amqp.v100.client.Producer@1a9447c, message=[AMQPMessage, header=[Header durable=TRUE, priority=5, firstAcquirer=FALSE, deliveryCount=0], properties=[Properties messageId=328538763985157080/1/5, userId=6F776E6572, to=Upstream_Bsci_10], amqpValue=[AmqpValue Message #6]], txnId=null, deliveryState=null, deliveryTag=null, recovery=false], linkCredit=45
SessionDispatcher, channel=0, , doSend, po=[POSendMessage, producer=com.swiftmq.amqp.v100.client.Producer@1a9447c, message=[AMQPMessage, header=[Header durable=TRUE, priority=5, firstAcquirer=FALSE, deliveryCount=0], properties=[Properties messageId=328538763985157080/1/5, userId=6F776E6572, to=Upstream_Bsci_10], amqpValue=[AmqpValue Message #6]], txnId=null, deliveryState=null, deliveryTag=null, recovery=false], dataLength=103
SessionDispatcher, channel=0, , doSend, remoteIncomingWindows=45, outgoingWindow=45, sending message, wasFirstPacket=true, maxSize=65536, packetSize=103, predictedNumberPackets=2, currentPacket=1, hasMore=false
amqp, SND[0] (size=148): [Transfer handle=0, deliveryId=7, deliveryTag=0000000000000006, messageFormat=0, settled=FALSE, more=FALSE, resume=FALSE, aborted=FALSE, batchable=FALSE, body=[0, 7, 0000000000000006, 0, FALSE, FALSE, NULL, NULL, FALSE, FALSE, FALSE]]
Sending Message #7
SessionDispatcher, channel=0, , visit, po=[POSendMessage, producer=com.swiftmq.amqp.v100.client.Producer@1a9447c, message=[AMQPMessage, header=[Header durable=TRUE, priority=5, firstAcquirer=FALSE, deliveryCount=0], properties=[Properties messageId=328538763985157080/1/5, userId=6F776E6572, to=Upstream_Bsci_10], amqpValue=[AmqpValue Message #6]], txnId=null, deliveryState=null, deliveryTag=null, recovery=false] done
SessionDispatcher, channel=0, , visit, po=[POSendMessage, producer=com.swiftmq.amqp.v100.client.Producer@1a9447c, message=[AMQPMessage, header=[Header durable=TRUE, priority=5, firstAcquirer=FALSE, deliveryCount=0], properties=[Properties messageId=328538763985157080/1/6, userId=6F776E6572, to=Upstream_Bsci_10], amqpValue=[AmqpValue Message #7]], txnId=null, deliveryState=null, deliveryTag=null, recovery=false] ...
SessionDispatcher, channel=0, , visit, po=[POSendMessage, producer=com.swiftmq.amqp.v100.client.Producer@1a9447c, message=[AMQPMessage, header=[Header durable=TRUE, priority=5, firstAcquirer=FALSE, deliveryCount=0], properties=[Properties messageId=328538763985157080/1/6, userId=6F776E6572, to=Upstream_Bsci_10], amqpValue=[AmqpValue Message #7]], txnId=null, deliveryState=null, deliveryTag=null, recovery=false], linkCredit=44
SessionDispatcher, channel=0, , doSend, po=[POSendMessage, producer=com.swiftmq.amqp.v100.client.Producer@1a9447c, message=[AMQPMessage, header=[Header durable=TRUE, priority=5, firstAcquirer=FALSE, deliveryCount=0], properties=[Properties messageId=328538763985157080/1/6, userId=6F776E6572, to=Upstream_Bsci_10], amqpValue=[AmqpValue Message #7]], txnId=null, deliveryState=null, deliveryTag=null, recovery=false], dataLength=103
SessionDispatcher, channel=0, , doSend, remoteIncomingWindows=44, outgoingWindow=44, sending message, wasFirstPacket=true, maxSize=65536, packetSize=103, predictedNumberPackets=2, currentPacket=1, hasMore=false
amqp, SND[0] (size=148): [Transfer handle=0, deliveryId=8, deliveryTag=0000000000000007, messageFormat=0, settled=FALSE, more=FALSE, resume=FALSE, aborted=FALSE, batchable=FALSE, body=[0, 8, 0000000000000007, 0, FALSE, FALSE, NULL, NULL, FALSE, FALSE, FALSE]]
Sending Message #8
SessionDispatcher, channel=0, , visit, po=[POSendMessage, producer=com.swiftmq.amqp.v100.client.Producer@1a9447c, message=[AMQPMessage, header=[Header durable=TRUE, priority=5, firstAcquirer=FALSE, deliveryCount=0], properties=[Properties messageId=328538763985157080/1/6, userId=6F776E6572, to=Upstream_Bsci_10], amqpValue=[AmqpValue Message #7]], txnId=null, deliveryState=null, deliveryTag=null, recovery=false] done
SessionDispatcher, channel=0, , visit, po=[POSendMessage, producer=com.swiftmq.amqp.v100.client.Producer@1a9447c, message=[AMQPMessage, header=[Header durable=TRUE, priority=5, firstAcquirer=FALSE, deliveryCount=0], properties=[Properties messageId=328538763985157080/1/7, userId=6F776E6572, to=Upstream_Bsci_10], amqpValue=[AmqpValue Message #8]], txnId=null, deliveryState=null, deliveryTag=null, recovery=false] ...
SessionDispatcher, channel=0, , visit, po=[POSendMessage, producer=com.swiftmq.amqp.v100.client.Producer@1a9447c, message=[AMQPMessage, header=[Header durable=TRUE, priority=5, firstAcquirer=FALSE, deliveryCount=0], properties=[Properties messageId=328538763985157080/1/7, userId=6F776E6572, to=Upstream_Bsci_10], amqpValue=[AmqpValue Message #8]], txnId=null, deliveryState=null, deliveryTag=null, recovery=false], linkCredit=43
SessionDispatcher, channel=0, , doSend, po=[POSendMessage, producer=com.swiftmq.amqp.v100.client.Producer@1a9447c, message=[AMQPMessage, header=[Header durable=TRUE, priority=5, firstAcquirer=FALSE, deliveryCount=0], properties=[Properties messageId=328538763985157080/1/7, userId=6F776E6572, to=Upstream_Bsci_10], amqpValue=[AmqpValue Message #8]], txnId=null, deliveryState=null, deliveryTag=null, recovery=false], dataLength=103
SessionDispatcher, channel=0, , doSend, remoteIncomingWindows=43, outgoingWindow=43, sending message, wasFirstPacket=true, maxSize=65536, packetSize=103, predictedNumberPackets=2, currentPacket=1, hasMore=false
amqp, SND[0] (size=148): [Transfer handle=0, deliveryId=9, deliveryTag=0000000000000008, messageFormat=0, settled=FALSE, more=FALSE, resume=FALSE, aborted=FALSE, batchable=FALSE, body=[0, 9, 0000000000000008, 0, FALSE, FALSE, NULL, NULL, FALSE, FALSE, FALSE]]
Sending Message #9
SessionDispatcher, channel=0, , visit, po=[POSendMessage, producer=com.swiftmq.amqp.v100.client.Producer@1a9447c, message=[AMQPMessage, header=[Header durable=TRUE, priority=5, firstAcquirer=FALSE, deliveryCount=0], properties=[Properties messageId=328538763985157080/1/7, userId=6F776E6572, to=Upstream_Bsci_10], amqpValue=[AmqpValue Message #8]], txnId=null, deliveryState=null, deliveryTag=null, recovery=false] done
SessionDispatcher, channel=0, , visit, po=[POSendMessage, producer=com.swiftmq.amqp.v100.client.Producer@1a9447c, message=[AMQPMessage, header=[Header durable=TRUE, priority=5, firstAcquirer=FALSE, deliveryCount=0], properties=[Properties messageId=328538763985157080/1/8, userId=6F776E6572, to=Upstream_Bsci_10], amqpValue=[AmqpValue Message #9]], txnId=null, deliveryState=null, deliveryTag=null, recovery=false] ...
SessionDispatcher, channel=0, , visit, po=[POSendMessage, producer=com.swiftmq.amqp.v100.client.Producer@1a9447c, message=[AMQPMessage, header=[Header durable=TRUE, priority=5, firstAcquirer=FALSE, deliveryCount=0], properties=[Properties messageId=328538763985157080/1/8, userId=6F776E6572, to=Upstream_Bsci_10], amqpValue=[AmqpValue Message #9]], txnId=null, deliveryState=null, deliveryTag=null, recovery=false], linkCredit=42
SessionDispatcher, channel=0, , doSend, po=[POSendMessage, producer=com.swiftmq.amqp.v100.client.Producer@1a9447c, message=[AMQPMessage, header=[Header durable=TRUE, priority=5, firstAcquirer=FALSE, deliveryCount=0], properties=[Properties messageId=328538763985157080/1/8, userId=6F776E6572, to=Upstream_Bsci_10], amqpValue=[AmqpValue Message #9]], txnId=null, deliveryState=null, deliveryTag=null, recovery=false], dataLength=103
SessionDispatcher, channel=0, , doSend, remoteIncomingWindows=42, outgoingWindow=42, sending message, wasFirstPacket=true, maxSize=65536, packetSize=103, predictedNumberPackets=2, currentPacket=1, hasMore=false
amqp, SND[0] (size=148): [Transfer handle=0, deliveryId=10, deliveryTag=0000000000000009, messageFormat=0, settled=FALSE, more=FALSE, resume=FALSE, aborted=FALSE, batchable=FALSE, body=[0, 10, 0000000000000009, 0, FALSE, FALSE, NULL, NULL, FALSE, FALSE, FALSE]]
Sending Message #10
SessionDispatcher, channel=0, , visit, po=[POSendMessage, producer=com.swiftmq.amqp.v100.client.Producer@1a9447c, message=[AMQPMessage, header=[Header durable=TRUE, priority=5, firstAcquirer=FALSE, deliveryCount=0], properties=[Properties messageId=328538763985157080/1/8, userId=6F776E6572, to=Upstream_Bsci_10], amqpValue=[AmqpValue Message #9]], txnId=null, deliveryState=null, deliveryTag=null, recovery=false] done
SessionDispatcher, channel=0, , visit, po=[POSendMessage, producer=com.swiftmq.amqp.v100.client.Producer@1a9447c, message=[AMQPMessage, header=[Header durable=TRUE, priority=5, firstAcquirer=FALSE, deliveryCount=0], properties=[Properties messageId=328538763985157080/1/9, userId=6F776E6572, to=Upstream_Bsci_10], amqpValue=[AmqpValue Message #10]], txnId=null, deliveryState=null, deliveryTag=null, recovery=false] ...
SessionDispatcher, channel=0, , visit, po=[POSendMessage, producer=com.swiftmq.amqp.v100.client.Producer@1a9447c, message=[AMQPMessage, header=[Header durable=TRUE, priority=5, firstAcquirer=FALSE, deliveryCount=0], properties=[Properties messageId=328538763985157080/1/9, userId=6F776E6572, to=Upstream_Bsci_10], amqpValue=[AmqpValue Message #10]], txnId=null, deliveryState=null, deliveryTag=null, recovery=false], linkCredit=41
SessionDispatcher, channel=0, , doSend, po=[POSendMessage, producer=com.swiftmq.amqp.v100.client.Producer@1a9447c, message=[AMQPMessage, header=[Header durable=TRUE, priority=5, firstAcquirer=FALSE, deliveryCount=0], properties=[Properties messageId=328538763985157080/1/9, userId=6F776E6572, to=Upstream_Bsci_10], amqpValue=[AmqpValue Message #10]], txnId=null, deliveryState=null, deliveryTag=null, recovery=false], dataLength=104
SessionDispatcher, channel=0, , doSend, remoteIncomingWindows=41, outgoingWindow=41, sending message, wasFirstPacket=true, maxSize=65536, packetSize=104, predictedNumberPackets=2, currentPacket=1, hasMore=false
amqp, SND[0] (size=149): [Transfer handle=0, deliveryId=11, deliveryTag=000000000000000A, messageFormat=0, settled=FALSE, more=FALSE, resume=FALSE, aborted=FALSE, batchable=FALSE, body=[0, 11, 000000000000000A, 0, FALSE, FALSE, NULL, NULL, FALSE, FALSE, FALSE]]
SessionDispatcher, channel=0, , visit, po=[POSendMessage, producer=com.swiftmq.amqp.v100.client.Producer@1a9447c, message=[AMQPMessage, header=[Header durable=TRUE, priority=5, firstAcquirer=FALSE, deliveryCount=0], properties=[Properties messageId=328538763985157080/1/9, userId=6F776E6572, to=Upstream_Bsci_10], amqpValue=[AmqpValue Message #10]], txnId=null, deliveryState=null, deliveryTag=null, recovery=false] done
amqp, RCV[0] (size=24): [Disposition role=TRUE, first=2, settled=TRUE, state=[Accepted ], batchable=FALSE]
SessionDispatcher, channel=0, , visit, po=[POConnectionFrameReceived, frame=[Disposition role=TRUE, first=2, settled=TRUE, state=[Accepted ], batchable=FALSE]] ...
SessionDispatcherFrameVisitor, , visit=[Disposition role=TRUE, first=2, settled=TRUE, state=[Accepted ], batchable=FALSE]
SessionDispatcher, channel=0, , visit, po=[POConnectionFrameReceived, frame=[Disposition role=TRUE, first=2, settled=TRUE, state=[Accepted ], batchable=FALSE]] done
amqp, RCV[0] (size=24): [Disposition role=TRUE, first=3, settled=TRUE, state=[Accepted ], batchable=FALSE]
SessionDispatcher, channel=0, , visit, po=[POConnectionFrameReceived, frame=[Disposition role=TRUE, first=3, settled=TRUE, state=[Accepted ], batchable=FALSE]] ...
SessionDispatcherFrameVisitor, , visit=[Disposition role=TRUE, first=3, settled=TRUE, state=[Accepted ], batchable=FALSE]
SessionDispatcher, channel=0, , visit, po=[POConnectionFrameReceived, frame=[Disposition role=TRUE, first=3, settled=TRUE, state=[Accepted ], batchable=FALSE]] done
amqp, RCV[0] (size=24): [Disposition role=TRUE, first=4, settled=TRUE, state=[Accepted ], batchable=FALSE]
SessionDispatcher, channel=0, , visit, po=[POConnectionFrameReceived, frame=[Disposition role=TRUE, first=4, settled=TRUE, state=[Accepted ], batchable=FALSE]] ...
SessionDispatcherFrameVisitor, , visit=[Disposition role=TRUE, first=4, settled=TRUE, state=[Accepted ], batchable=FALSE]
SessionDispatcher, channel=0, , visit, po=[POConnectionFrameReceived, frame=[Disposition role=TRUE, first=4, settled=TRUE, state=[Accepted ], batchable=FALSE]] done
amqp, RCV[0] (size=24): [Disposition role=TRUE, first=5, settled=TRUE, state=[Accepted ], batchable=FALSE]
SessionDispatcher, channel=0, , visit, po=[POConnectionFrameReceived, frame=[Disposition role=TRUE, first=5, settled=TRUE, state=[Accepted ], batchable=FALSE]] ...
SessionDispatcherFrameVisitor, , visit=[Disposition role=TRUE, first=5, settled=TRUE, state=[Accepted ], batchable=FALSE]
SessionDispatcher, channel=0, , visit, po=[POConnectionFrameReceived, frame=[Disposition role=TRUE, first=5, settled=TRUE, state=[Accepted ], batchable=FALSE]] done
amqp, RCV[0] (size=24): [Disposition role=TRUE, first=6, settled=TRUE, state=[Accepted ], batchable=FALSE]
SessionDispatcher, channel=0, , visit, po=[POConnectionFrameReceived, frame=[Disposition role=TRUE, first=6, settled=TRUE, state=[Accepted ], batchable=FALSE]] ...
SessionDispatcherFrameVisitor, , visit=[Disposition role=TRUE, first=6, settled=TRUE, state=[Accepted ], batchable=FALSE]
SessionDispatcher, channel=0, , visit, po=[POConnectionFrameReceived, frame=[Disposition role=TRUE, first=6, settled=TRUE, state=[Accepted ], batchable=FALSE]] done
amqp, RCV[0] (size=24): [Disposition role=TRUE, first=7, settled=TRUE, state=[Accepted ], batchable=FALSE]
SessionDispatcher, channel=0, , visit, po=[POConnectionFrameReceived, frame=[Disposition role=TRUE, first=7, settled=TRUE, state=[Accepted ], batchable=FALSE]] ...
SessionDispatcherFrameVisitor, , visit=[Disposition role=TRUE, first=7, settled=TRUE, state=[Accepted ], batchable=FALSE]
SessionDispatcher, channel=0, , visit, po=[POConnectionFrameReceived, frame=[Disposition role=TRUE, first=7, settled=TRUE, state=[Accepted ], batchable=FALSE]] done
amqp, RCV[0] (size=24): [Disposition role=TRUE, first=8, settled=TRUE, state=[Accepted ], batchable=FALSE]
SessionDispatcher, channel=0, , visit, po=[POConnectionFrameReceived, frame=[Disposition role=TRUE, first=8, settled=TRUE, state=[Accepted ], batchable=FALSE]] ...
SessionDispatcherFrameVisitor, , visit=[Disposition role=TRUE, first=8, settled=TRUE, state=[Accepted ], batchable=FALSE]
SessionDispatcher, channel=0, , visit, po=[POConnectionFrameReceived, frame=[Disposition role=TRUE, first=8, settled=TRUE, state=[Accepted ], batchable=FALSE]] done
amqp, RCV[0] (size=24): [Disposition role=TRUE, first=9, settled=TRUE, state=[Accepted ], batchable=FALSE]
SessionDispatcher, channel=0, , visit, po=[POConnectionFrameReceived, frame=[Disposition role=TRUE, first=9, settled=TRUE, state=[Accepted ], batchable=FALSE]] ...
SessionDispatcherFrameVisitor, , visit=[Disposition role=TRUE, first=9, settled=TRUE, state=[Accepted ], batchable=FALSE]
SessionDispatcher, channel=0, , visit, po=[POConnectionFrameReceived, frame=[Disposition role=TRUE, first=9, settled=TRUE, state=[Accepted ], batchable=FALSE]] done
amqp, RCV[0] (size=24): [Disposition role=TRUE, first=10, settled=TRUE, state=[Accepted ], batchable=FALSE]
SessionDispatcher, channel=0, , visit, po=[POConnectionFrameReceived, frame=[Disposition role=TRUE, first=10, settled=TRUE, state=[Accepted ], batchable=FALSE]] ...
SessionDispatcherFrameVisitor, , visit=[Disposition role=TRUE, first=10, settled=TRUE, state=[Accepted ], batchable=FALSE]
SessionDispatcher, channel=0, , visit, po=[POConnectionFrameReceived, frame=[Disposition role=TRUE, first=10, settled=TRUE, state=[Accepted ], batchable=FALSE]] done
amqp, RCV[0] (size=24): [Disposition role=TRUE, first=11, settled=TRUE, state=[Accepted ], batchable=FALSE]
SessionDispatcher, channel=0, , visit, po=[POConnectionFrameReceived, frame=[Disposition role=TRUE, first=11, settled=TRUE, state=[Accepted ], batchable=FALSE]] ...
SessionDispatcherFrameVisitor, , visit=[Disposition role=TRUE, first=11, settled=TRUE, state=[Accepted ], batchable=FALSE]
SessionDispatcher, channel=0, , visit, po=[POConnectionFrameReceived, frame=[Disposition role=TRUE, first=11, settled=TRUE, state=[Accepted ], batchable=FALSE]] done
SessionDispatcher, channel=0, , visit, po=[POCloseLink, link=com.swiftmq.amqp.v100.client.Producer@1a9447c] ...
SessionDispatcher, channel=0, , visit, po=[POCloseLink, link=com.swiftmq.amqp.v100.client.Producer@1a9447c] done
amqp, SND[0] (size=23): [Detach handle=0, closed=TRUE]
amqp, RCV[0] (size=17): [Detach handle=0, closed=TRUE]
SessionDispatcher, channel=0, , visit, po=[POConnectionFrameReceived, frame=[Detach handle=0, closed=TRUE]] ...
SessionDispatcherFrameVisitor, , visit=[Detach handle=0, closed=TRUE]
SessionDispatcher, channel=0, , visit, po=[POConnectionFrameReceived, frame=[Detach handle=0, closed=TRUE]] done
SessionDispatcher, channel=0, , visit, po=[POSendEnd, condition=null] ...
amqp, SND[0] (size=20): [End ]
SessionDispatcher, channel=0, , visit, po=[POSendEnd, condition=null] done
amqp, RCV[0] (size=15): [End ]
ConnectionDispatcher, , visit, po=[POConnectionFrameReceived, frame=[End ], sassl=false] ...
ConnectionVisitor, , visit=[End ]
SessionDispatcher, channel=0, , visit, po=[POConnectionFrameReceived, frame=[End ]] ...
SessionDispatcherFrameVisitor, , visit=[End ]
ConnectionDispatcher, , visit, po=[POConnectionFrameReceived, frame=[End ], sassl=false] done
SessionDispatcher, channel=0, , visit, po=[POConnectionFrameReceived, frame=[End ]] done
SessionDispatcher, channel=0, , close ...
SessionDispatcher, channel=0, , visit, po=[POSessionClose] ...
SessionDispatcher, channel=0, , close done
SessionDispatcher, channel=0, , visit, po=[POSessionClose] done
ConnectionDispatcher, , visit, po=[POSendClose, condition=null, description=null] ...
amqp, SND[0] (size=20): [Close ]
ConnectionDispatcher, , visit, po=[POSendClose, condition=null, description=null] done
amqp, RCV[0] (size=15): [Close ]
ConnectionDispatcher, , visit, po=[POConnectionFrameReceived, frame=[Close ], sassl=false] ...
ConnectionVisitor, , visit=[Close ]
ConnectionDispatcher, , close ...
ConnectionDispatcher, , visit, po=[POConnectionFrameReceived, frame=[Close ], sassl=false] done
ConnectionDispatcher, , visit, po=[POConnectionClose] ...
ConnectionDispatcher, , visit, po=[POConnectionClose] done
ConnectionDispatcher, , close done
Reply | Threaded
Open this post in threaded view
|

Re: "Connection was Asynchronously terminated" on .connect() call. Corporate networks

IIT Software
Administrator
I've just tested it here with ServiceBus and it works like a charm. See below. That must be something else if that works within one subnet and not within the other. Never seen that before.

./starter SenderNonTransacted swiftmq.servicebus.windows.net 5671 testqueue 1 EXACTLY_ONCE false swiftmq "xxx"

Host        : swiftmq.servicebus.windows.net
Port        : 5671
Target      : testqueue
Number Msgs : 1
QoS         : EXACTLY_ONCE
Auth as Anon: false
User        : swiftmq
Password    : xxxx

Using SSL on port 5671
ConnectionDispatcher, , visit, po=[POProtocolRequest, header=[ProtocolHeader, name=AMQP, id=3, major=1, minor=0, revision=0]] ...
ConnectionDispatcher, , visit, po=[POProtocolRequest, header=[ProtocolHeader, name=AMQP, id=3, major=1, minor=0, revision=0]] done
amqp, SND: [ProtocolHeader, name=AMQP, id=3, major=1, minor=0, revision=0]
amqp, RCV: [ProtocolHeader, name=AMQP, id=3, major=1, minor=0, revision=0]
ConnectionDispatcher, , visit, po=[POProtocolResponse, header=[ProtocolHeader, name=AMQP, id=3, major=1, minor=0, revision=0]] ...
ConnectionDispatcher, , visit, po=[POProtocolResponse, header=[ProtocolHeader, name=AMQP, id=3, major=1, minor=0, revision=0]] done
ConnectionDispatcher, , visit, po=[POAuthenticate, mechanism=PLAIN, username=swiftmq, password=fyV1gNur6GSoZmeJ2cfyEBsVYagsh0NUfFo0NCfVGf8=] ...
ConnectionDispatcher, , visit, po=[POAuthenticate, mechanism=PLAIN, username=swiftmq, password=fyV1gNur6GSoZmeJ2cfyEBsVYagsh0NUfFo0NCfVGf8=] done
amqp, RCV[0] (size=39): [SaslMechanisms saslServerMechanisms=[PLAIN, EXTERNAL]]
ConnectionDispatcher, , visit, po=[POConnectionFrameReceived, frame=[SaslMechanisms saslServerMechanisms=[PLAIN, EXTERNAL]], sassl=true] ...
ConnectionVisitor, , visit=[SaslMechanisms saslServerMechanisms=[PLAIN, EXTERNAL]]
ConnectionDispatcher, , visit, po=[POConnectionFrameReceived, frame=[SaslMechanisms saslServerMechanisms=[PLAIN, EXTERNAL]], sassl=true] done
amqp, SND[0] (size=115): [SaslInit mechanism=PLAIN, initialResponse=0073776966746D710066795631674E75723647536F5A6D654A32636679454273565961677368304E5566466F304E4366564766383D, hostname=swiftmq.servicebus.windows.net]
amqp, RCV[0] (size=26): [SaslOutcome mycode=0, additionalData=57656C636F6D6521]
ConnectionDispatcher, , visit, po=[POConnectionFrameReceived, frame=[SaslOutcome mycode=0, additionalData=57656C636F6D6521], sassl=true] ...
ConnectionVisitor, , visit=[SaslOutcome mycode=0, additionalData=57656C636F6D6521]
ConnectionDispatcher, , visit, po=[POConnectionFrameReceived, frame=[SaslOutcome mycode=0, additionalData=57656C636F6D6521], sassl=true] done
ConnectionDispatcher, , visit, po=[POProtocolRequest, header=[ProtocolHeader, name=AMQP, id=0, major=1, minor=0, revision=0]] ...
ConnectionDispatcher, , visit, po=[POProtocolRequest, header=[ProtocolHeader, name=AMQP, id=0, major=1, minor=0, revision=0]] done
amqp, SND: [ProtocolHeader, name=AMQP, id=0, major=1, minor=0, revision=0]
amqp, RCV: [ProtocolHeader, name=AMQP, id=0, major=1, minor=0, revision=0]
ConnectionDispatcher, , visit, po=[POProtocolResponse, header=[ProtocolHeader, name=AMQP, id=0, major=1, minor=0, revision=0]] ...
ConnectionDispatcher, , visit, po=[POProtocolResponse, header=[ProtocolHeader, name=AMQP, id=0, major=1, minor=0, revision=0]] done
ConnectionDispatcher, , visit, po=[POOpen, containerId=dbf82e45-5027-4cdf-bdc0-b938826496f7@imac-buero, maxFrameSize=2147483647, maxChannel=255, idleTimeout=9223372036854775807] ...
ConnectionDispatcher, , visit, po=[POOpen, containerId=dbf82e45-5027-4cdf-bdc0-b938826496f7@imac-buero, maxFrameSize=2147483647, maxChannel=255, idleTimeout=9223372036854775807] done
amqp, SND[0] (size=115): [Open containerId=dbf82e45-5027-4cdf-bdc0-b938826496f7@imac-buero, hostname=swiftmq.servicebus.windows.net, maxFrameSize=2147483647, channelMax=255, idleTimeOut=4294967295]
amqp, RCV[0] (size=71): [Open containerId=4fb380c211944b34b799eed9f1b13ecb_G11, maxFrameSize=65536, channelMax=255, idleTimeOut=240000]
ConnectionDispatcher, , visit, po=[POConnectionFrameReceived, frame=[Open containerId=4fb380c211944b34b799eed9f1b13ecb_G11, maxFrameSize=65536, channelMax=255, idleTimeOut=240000], sassl=false] ...
ConnectionVisitor, , visit=[Open containerId=4fb380c211944b34b799eed9f1b13ecb_G11, maxFrameSize=65536, channelMax=255, idleTimeOut=240000]
ConnectionDispatcher, , visit, po=[POConnectionFrameReceived, frame=[Open containerId=4fb380c211944b34b799eed9f1b13ecb_G11, maxFrameSize=65536, channelMax=255, idleTimeOut=240000], sassl=false] done
SessionDispatcher, channel=0, , visit, po=[POBegin] ...
SessionDispatcher, channel=0, , visit, po=[POBegin] done
amqp, SND[0] (size=42): [Begin nextOutgoingId=1, incomingWindow=50, outgoingWindow=50, handleMax=2147483647]
amqp, RCV[0] (size=28): [Begin remoteChannel=0, nextOutgoingId=1, incomingWindow=50, outgoingWindow=50, handleMax=7]
ConnectionDispatcher, , visit, po=[POConnectionFrameReceived, frame=[Begin remoteChannel=0, nextOutgoingId=1, incomingWindow=50, outgoingWindow=50, handleMax=7], sassl=false] ...
ConnectionVisitor, , visit=[Begin remoteChannel=0, nextOutgoingId=1, incomingWindow=50, outgoingWindow=50, handleMax=7]
ConnectionDispatcher, , visit, po=[POConnectionFrameReceived, frame=[Begin remoteChannel=0, nextOutgoingId=1, incomingWindow=50, outgoingWindow=50, handleMax=7], sassl=false] done
SessionDispatcher, channel=0, , visit, po=[POConnectionFrameReceived, frame=[Begin remoteChannel=0, nextOutgoingId=1, incomingWindow=50, outgoingWindow=50, handleMax=7]] ...
SessionDispatcherFrameVisitor, , visit=[Begin remoteChannel=0, nextOutgoingId=1, incomingWindow=50, outgoingWindow=50, handleMax=7]

...
Reply | Threaded
Open this post in threaded view
|

Re: "Connection was Asynchronously terminated" on .connect() call. Corporate networks

IIT Software
Administrator
In reply to this post by philware
Is there any difference in the JDK version of the different hosts you use?
Reply | Threaded
Open this post in threaded view
|

Re: "Connection was Asynchronously terminated" on .connect() call. Corporate networks

philware
The java JDK we are using is:

bsc@NN2510-001011:~$ java -version
java version "1.7.0_45"
Java(TM) SE Runtime Environment (build 1.7.0_45-b18)
Java HotSpot(TM) Client VM (build 24.45-b08, mixed mode)

This is the same version throughout all of our systems.

The system which is going wrong was confirmed to be working at our own site before being placed at another company with a more "corporate" type network.

The product is a closed boxed running Linux which is not tampered with by the other company. I.e. it is not some software somebody runs on a PC.

The version of linux we are running in this product is:
"Debian GNU/Linux 7 (wheezy)"


Regards,
Phil.
Reply | Threaded
Open this post in threaded view
|

Re: "Connection was Asynchronously terminated" on .connect() call. Corporate networks

IIT Software
Administrator
Well, I'm afraid but I can't help then. Never heard of a case where you move a working box to another location and it missed data before it is being sent to the network.
Reply | Threaded
Open this post in threaded view
|

Re: "Connection was Asynchronously terminated" on .connect() call. Corporate networks

philware
This post was updated on .
Obviously there is a bug in the ConnectionDispatcher which is wiping out the containerId value, after being set by the constructor, depending on some network/firewall issue.

Test System:
Basic Debian GNU/Linux 7 (wheezy)
Java(TM) SE Runtime Environment (build 1.7.0_45-b18)
Running SenderNonTransaction Test.

Test system 1) Basic network to internet, not corporate
Test system 2) Corporate network, Firewalls, Proxies etc.
Test system 2) Corporate network, Firewalls, Proxies etc.

Problem:
SwiftMQ Works file on Test System 1
SwiftMQ Fails at .connection() with Connection was Asynchornously Terminated on Test System 2 & 3
Debug shows that the containerId is null.

Work-Around:
Specifically set the containerId property of the connection.

NOTE:
Apache QPID client (with basic settings) works fine on all three Test Systems.


Regards,
Phil.
Reply | Threaded
Open this post in threaded view
|

Re: "Connection was Asynchronously terminated" on .connect() call. Corporate networks

IIT Software
Administrator
It can't be a network issue because the output is before it is sent to the network.

Did you perform a test on the systems 2 or 3 with a local SwiftMQ AMQP Router and connecting locally over SSL? You need to set -Dswiftmq.jsse.anoncipher.enabled=true at the SwiftMQ client.
Reply | Threaded
Open this post in threaded view
|

Re: "Connection was Asynchronously terminated" on .connect() call. Corporate networks

philware
Our current thinking is that there are some network calls being made before the .connect() because the containerId contains the hostname.

Our system:
containerId=8d5297f8-b48d-4e2a-88cf-36e58c374542@NN2510-000895

And in your case:
containerId=dbf82e45-5027-4cdf-bdc0-b938826496f7@imac-buero


I will add more debug to show the containerId value after the constructor, before the .connect() and when it has thrown the exception.


regards,
Phil.
Reply | Threaded
Open this post in threaded view
|

Re: "Connection was Asynchronously terminated" on .connect() call. Corporate networks

IIT Software
Administrator
You got it! This call fails with an UnknownHostException:

    try
    {
      containerId = UUID.randomUUID().toString() + "@" + InetAddress.getLocalHost().getHostName();
    } catch (UnknownHostException e)
    {
    }

Please check if you have configured the local hostname on that boxes resp. if that is a DNS issue.
12