With a contract to be renewed at the end of the season, Shrimpers fans website S24 speculated on Thursday that Aberdeen may have to accept that McArdle is looking to make a move down south.
But Brown has now said that McArdle is going nowhere and is part of his future plans.
This means Northern Irishman McArdle has been denied the chance to join up with Southend manager Paul Sturrock once again.
The young defender played under Sturrock at Sheffield Wednesday with McArdle making only one appearance in his time as a teenager at Hillsborough.
And Sturrock made a bid to bring McArdle down to Southend last summer, which was again rebuffed.