Unity Call handler DTMF issue

It was around Halloween time. I was building one call handler for each local site. We start getting ticket saying unity Caller option "0" ring on caller input "2".Hmm. Really!! Who cares, it must be user error. Unfortunately, more ticket started to come. This is alarming for sure. Now it's the time get to the bottom of this. Lets' dig in.

I build another call handler. See if I can replicate the same issue. After making around 8-9 call. It is happening. What the hell is going on here?
Hmm, Opened a ticket with Cisco. We did some capture on ISR4321. but we're not able to see what DTMF code we were receiving on CUBE. Then Cisco said this model does not show DTMF. SO we did capture on cube network port.

Long story short......It was AT&T was sending us wrong DTMF.

At&T "After referring this issue to our Sonus TSM support, they did some maintenance to refresh DSP cards the customers failed calls went over. Please have the customer retry these calls to ensure their DTMF issue is now resolved."

 Good Day.

T-Shoot 101: SIP UDP packet disappear...

MY favourite quote

"In VOIP world figuring out a call flow, is very much like following the bouncing ball"

VOIP firewall!!

Root Cause!!

We engineer would like to think everything happened for a reason, right? But sometimes we see some unusual phone behavior  I can't find any explanation for my customer.

*one extension was used as a shared line but was only ringing on one phone only!!!

Phone reset resolve that issue.Reason: was registered to the different subscriber.
??

*Sometimes No dial tone.Normally phone reset to resolve this issue.But Cisco was kind enough to give us an engineer special firmware version for the phone.
>Not sure that resolve the issue.But still having the same phone stuck with an older version.
?Why now? same firmware we have been using for last six month everything was working fine.


* Couple of TAC Case was open phone going to VM and user can't dial out.On-call manager everything was fine.

Subscriber not backing up!!

 We have a total of 12 subscribers, including one publisher and two tftp servers. One of our subscriber that was added to cluster recently was not backing up on publisher, we are getting used is not backed up for more than 10+ days.


I dig some website and found this might be the case...
FYI: for us it was not the real issue. We had something to do network I still need figure out what was exactly caused this issue from the Networking firewall team!! Until then please wait...

Try restarting DRF Local/Master services.It should fix that issue but not 100% guaranteed (reference from some other Cisco support forum also it was a none bug on 8.6). If that still doesn’t resolve the issue,we will have  go to the Pub/Sub's OS Admin page to re-generate the IPSec certificate, and then restart the DRS service in Pub/PSAC2.

https://supportforums.cisco.com/discussion/11605411/cucm-drs-backup-fails-one-subscribers

https://supportforums.cisco.com/discussion/11806556/cucm-back-issue-unable-contact-server-master-or-local-agent-could-be-down

Lesson learnd 2

This one is much more interesting.More like silly mistake turn into huge issue and CNS case open..well they dig into that for hours couldn't find the issue.Until I am the only Hero more like problem maker (:P decided to show up and fix that issue! Feel sorry for those people they had to spend long stressful night... We have an urgent requirement that when reception forward call to someone calling party should not hear ringing... Hmm

The reason behind is they want to take their time before answer those phones. maybe they are super busy all callers have to wait for a while. Well, none of my headache.. Now my question it how do I achieve that.. Think brain think.

In North America, the standard ring-back tone is a repeating 2-second tone with a 4-second pause between. The tone is 440 Hz + 480 Hz. (A little wise talk)

As far as I know some country does offer music instead of ring back tone

So how did we achieve that..stay tuned..

Lesson learned!! a

We ware implementing PLAR/Hotline whatever you would like to call for some very, very important person and department. We tested PLAR configuration on test phone and everything works fine. Now time to deploy on production environment.

Well, for the sip phone you need to have a sip dial on the phone. But nobody knew you have to define which line button you using PLAR and apply a SIP dial rule on that button.

So we deployed and all call made on those phone was going through the PLAR destination line.Untill know body knew sip dial rule have to defile which button you using for PLAR..... It was such a disaster :D

Lesson learned!!

Cut-over again

What else in earth could go wrong.

1. Not enough PoE.
on cutover  night we are deploynig around 290+ phone on one floor of the huge building.After deploying half phone .somephone is not powering up.there you go PoE sortage ..Haha! what do we do .Time was around 11PM.shall we have to rollback .wr we will get poe switch that time of the night.

2. Out of IP address.

3.Vlan communication block on firewall.

4.No option 150 for DHCP scope.

5.Wiring issue.

6.Some room was looked early.

cont..

Cut-over disaster!!

Well whos fault was that..Not mine lets point finger each other.

FYI! It was not really a disaster ..Eventually we endue migrate 270 phone successfully moving from Nortel to Cisco.The main reason we ware on panicking because there is no window for making any mistake.It's like if you do mistake or if you can't do it you will be hang  or life sentence in prison.

Couple of issue we had to deal with.Only reason I am writing because I want to remember this horrible night my entire life.

* Initially 270 phone to deploy time window (7pm-11pm) .We end up finish all at 6AM morning :) Smile)

* Some of information was given to us was wrong.

*  We did not had enough PoE on middle of our deployment.

*this one much better there was not enough VLAN or IP address to cover all those phone.(Note: To remmber it was not easy to add VLAN or IP. There was like two week protocol to follow to get those approved..lol)

*Those project manager we had not all of they know what they are doing.Not  complaining I am sure managing all those stuff is hard .Just think maybe it would've been much better if there ware proper plan and coordination with networking or other team was on the place.

*Plus it was far from my house and I did not show up next day well my excuse is I was there until 6am plus 2hour to my house.There was like so many ticket was opend and so many phone was not registering and  only one guy to deal with all those and he as kinda new to all those too.Okey okey I know I know all blame on me I am talking blame for that.I know I am getting old and becoming a little too lazy.plus I am getting fat bally now this days.

Not good !! Well lesson learned.

Back Again!

Okay here it goes. It’s been a while I was thinking to write on this blog again. But entire 2015 I was too busy with my life. I moved from UK to USA  and search for job plus settling down in new place trust its not that easy as you think.I was too busy to write.

Here you go I started this project with a huge company they have 10 subscribers 1 publisher 1 TFTP..... Still have lots to dig in.

I am hoping to be regular here on this blog. Note: I am using this blog entirely solo purpose to keep note for myself. I do know some of those sentence may not make seance to you. It is only and only for me to keep trace of my work, keep note and learn lesson for future. Good Luck buddy!