All Systems Operational
Voice / Messaging API's Operational
Inbound Voice US ? Operational
Outbound Voice US ? Operational
Inbound SMS US ? Operational
Outbound SMS US ? Operational
Transcription ? Operational
api.tropo.com (Tokens) ? Operational
Provisioning / Hosting Operational
api.tropo.com (Provisioning) ? Operational
Webhosting Operational
ftp.tropo.com ? Operational
Tropo.com Website ? Operational
Tropo.eu Operational
Outbound SMS EU Operational
Inbound SMS EU Operational
Outbound Voice EU Operational
Inbound Voice EU Operational
api.tropo.eu (Tokens) Operational
Operational
Degraded Performance
Partial Outage
Major Outage
Maintenance
Scheduled Maintenance
WHAT - The Tropo.com Development env currently runs in the SJC datacenter; we're moving all Dev env traffic to the WDC datacenter.

WHEN - Wednesday 8/23/2017, scheduled from 9:00pm -et through 11:30pm. This was planned the day before but got moved 1 day later.

IMPACT - There will be no downtime; work will be conducted on redundant systems removed from availability.

WHY - The new hardware is racked and ready to roll. Eventually Production traffic will be migrated to WDC as well.
Posted on Aug 23, 14:31 EDT
Past Incidents
Aug 23, 2017

No incidents reported today.

Aug 22, 2017
Completed - The scheduled maintenance has been completed.
Aug 22, 23:30 EDT
In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
Aug 22, 21:00 EDT
Scheduled - WHAT?
* Cutting over api.tropo.eu (Tropo.eu) from the current infrastructure to the Global Gateway service group.
* Applying a config change to all Dedicated Gateways so http traffic is only listened for on specific devices.
* The Tropo.com Development env currently runs in the SJC datacenter; we're moving all Dev env traffic to the WDC datacenter.

WHEN?
* Tuesday 8/22/2017, scheduled from 9:00pm -et through 11:30pm.

IMPACT:
* There will be no downtime; work will be conducted on redundant systems removed from availability.

WHY?
* Moving to the "global" gateway philosophy will provide greater resiliency, and expanded capacity as Tropo continues to grow.
* Just a security thing; if it's not used, we're turning it off.
* The new hardware is racked and ready to roll. Eventually Production traffic will be migrated to WDC as well.
Aug 18, 19:57 EDT
Aug 21, 2017

No incidents reported.

Aug 20, 2017

No incidents reported.

Aug 19, 2017

No incidents reported.

Aug 18, 2017

No incidents reported.

Aug 17, 2017

No incidents reported.

Aug 16, 2017
Completed - The scheduled maintenance has been completed.
Aug 16, 22:01 EDT
In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
Aug 16, 21:01 EDT
Scheduled - WHAT?
* Cutting over api.tropo.com from the current infrastructure to the Global Gateway service group. This was previously attempted on 7/25/2017, but was reverted due to an isolated bug. We've corrected the issue and are ready to move forward.

WHEN?
* Wednesday 8/16/2017, scheduled from 9:00pm -et through 10:00pm.

IMPACT:
* There will be no downtime; work will be conducted on redundant systems removed from availability.

WHY?
* Moving to the "global" gateway philosophy will provide greater resiliency, and expanded capacity as Tropo continues to grow.
Aug 11, 18:09 EDT
Aug 15, 2017
Completed - The scheduled maintenance has been completed.
Aug 15, 23:46 EDT
In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
Aug 15, 21:01 EDT
Scheduled - WHAT?
* Installing an upgrade to the internal service discovery platform consumed by Tropo.com Production services.
* Applying a config change to all Shared Prod Gateways so http traffic is only listened for on specific devices.
* Deploying a patch to the Global Gateway hosts.
* Our billing provider will be deploying an upgrade to their backend infrastructure.

WHEN?
* Tuesday 8/15/2017, scheduled from 9:00pm -et through 11:45pm.

IMPACT:
* There will be no downtime; work will be conducted on redundant systems removed from availability. However, for the duration of this maintenance moving apps to Production, and adding new phone numbers to Production apps will be temporarily disabled. Accordingly, the portals for Tropo.com & Tropo.eu will be placed into a read-only maintenance mode.

WHY?
* The latest version contains some corrections and security enhancements that we want.
* Just a security thing; if it's not used, we're turning it off.
* This patch will correct an isolated issue that was identified during the previous attempt to migrate the API to Global Gateway.
* Our provider will be deploying an enhancement to their active rating service.
Aug 11, 18:06 EDT
Aug 14, 2017
Completed - This is done.
Aug 14, 21:57 EDT
In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
Aug 14, 21:01 EDT
Scheduled - WHAT?
* Applying a config change on the Dedicated Env gateways that will disable parsing and support for SIP bang outbound calling.

WHEN?
* Monday 8/14/2017, scheduled from 9:00pm -et through 10:00pm.

IMPACT:
* There will be no downtime; work will be conducted on redundant systems removed from availability.

WHY?
* This is a legacy feature no longer used across the platform, and we've recently observed a case where its header parsing may not be inline with SIP specs.
Aug 11, 17:34 EDT
Aug 13, 2017

No incidents reported.

Aug 12, 2017

No incidents reported.

Aug 11, 2017
Resolved - This incident has been resolved.
Aug 11, 12:10 EDT
Monitoring - A fix has been implemented and we are monitoring the results.
Aug 10, 21:19 EDT
Investigating - We are seeing errors from a subset of speech servers in our EU data center. We are investigating at this time.
Aug 10, 18:14 EDT
Completed - This is now complete.
Aug 11, 11:30 EDT
In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
Aug 11, 11:15 EDT
Scheduled - WHAT?
* Applying a config change on the Dev gateways that will disable parsing and support for SIP bang outbound calling.

WHEN?
* Now; Friday 8/11/2017, scheduled from 11:15am -et through 11:45am.

IMPACT:
* There will be no downtime; work will be conducted on redundant systems removed from availability.

WHY?
* This is a legacy feature no longer used across the platform, and we've recently observed a case where its header parsing may not be inline with SIP specs.
Aug 11, 10:59 EDT
Aug 9, 2017
Resolved - This incident has been resolved.
Aug 9, 22:26 EDT
Monitoring - Services appear to be restored at this time but we will continue to monitor it for the next few hours closely.
Aug 9, 12:31 EDT
Update - Our vendor has confirmed an issue w/ their service and are working to restore full service. We will post updates as soon as we have any additional information.
Aug 9, 10:45 EDT
Identified - We are seeing issues with our upstream transcription provider at this time. We are working with our vendor to address tis issue at this time.
Aug 9, 08:14 EDT