The complaint was registered in Ranaghat police station of Nadia district by a Trinamool Congress worker Krishnendu Banerjee, who alleged that Ghosh was inciting communal passion.
Addressing a party rally on Sunday in Ranathat, about 80 km from Kolkata, Ghosh went ballistic, saying the governments in BJP-ruled Assam, Karnataka and Uttar Pradesh have shot dead "like dogs" those protesting against the new Citizenship (Amendment) Act.
Alleging there were one crore infiltrators in the state, Ghosh had accused them of destroying public property worth Rs 500-600 crore during the violent protests against the CAA last month.
"Friends, please know these people who are opposing Hindus and Bengalis. In whose interest are they doing this? There are one crore infiltrators. They are having their meals and staying here on our money".
He accused the state's Mamata Banerjee government of remaining silent a spectator to the violence.
"This (violence) happened because there was neither any baton charge, nor firing, nor was any FIR filed. Why? Didi's (elder sister, as Mamata Banerjee is popularly called) police did not arrest anybody... because they vote for her".
He then referred to the three states ruled by the BJP.
"In Assam, Karnataka and Uttar Pradesh, our governments have shot dead these devils like dogs. They were taken elsewhere and then again cases were filed against them. They will come here, eat, stay, and then destroy property. Do they think this is their zamindari?"
He had said once a BJP government was installed in Bengal, "We will hit them with sticks, shoot them and also send them to jail. Our governments have done exactly that. Mamata Banerjee doesn't have the guts to do anything".
However, his incendiary comments did not meet the approval of sections in the party.
Union Minister Babul Supriyo came out with a tweet slamming Ghosh and distancing the BJP from the comments.
"Very irresponsible of Dilip Da to have said what he said. It is a figment of his imagination... BJP governments in UP and Assam have never resorted to shooting people for whatever reason," he tweeted.
Supriyo's tweet was retweeted by nominated Rajya Sabha member Swapan Dasgupta, considered close to both Prime Minister Narendra Modi and Home Minister Amit Shah.
But Ghosh did not budge,and aggressively asked whether the party was being run by Shah or Supriyo.
"People comment according to their understanding. What I feel is that our governments have done it, and so I said all that. If we get a chance we will also do such things," he said, sticking to his earlier comments.
Supriyo also hit back. "Just as he has remarked 'whatever Babul Supriyo has understood he has said', similarly I am saying this is Dilip da's personal opinion, and it has no connection with the party".
( With inputs from IANS )