Update - The code change which triggered this event has been rolled back. Our engineering team has repaired affected data for users in LDAP-based accounts by correcting their Active status. These users will no longer trigger false positive alerts.
This issue affected cloud-based and LDAP-based accounts. Our engineers are continuing to move groups of users back to their correct status. You should expect to see an ongoing reduction in false positive alerts as this work progresses toward completion. Cloud and SaaS users are more likely to be affected than others.
Finally, InsightIDR’s normal process of categorization has the ability to repair incorrectly categorized users over time. As incorrectly categorized users log in, they are moved into an Active state, eliminating further alerts.
This issue has not resulted in any data loss.
We will continue to update the status page with the latest information.
Jan 20, 2023 - 23:35 UTC
This issue affected cloud-based and LDAP-based accounts. Our engineers are continuing to move groups of users back to their correct status. You should expect to see an ongoing reduction in false positive alerts as this work progresses toward completion. Cloud and SaaS users are more likely to be affected than others.
Finally, InsightIDR’s normal process of categorization has the ability to repair incorrectly categorized users over time. As incorrectly categorized users log in, they are moved into an Active state, eliminating further alerts.
This issue has not resulted in any data loss.
We will continue to update the status page with the latest information.
Jan 20, 2023 - 23:35 UTC
Update - We identified an issue with a recent change in our system that affected the way InsightIDR interprets whether a user is active or not. As a result, InsightIDR incorrectly labeled some active users as "Removed", which impacted some alerts associated with those users:
- In some cases, a large number of false positive "First Ingress Authentication from Country" and “Bruteforce from Unknown Source” alerts were generated.
- Some “Ingress From Disabled Account” alerts that should have fired, did not.
- Some alert modifications for the above alerts may not have been applied.
Our response and next steps:
Rapid7 Engineering teams are working on a fix to revert all users that were incorrectly labeled as “Removed” to their original “Active” status.
We will continue to update the status page with the latest information.
Jan 18, 2023 - 20:25 UTC
- In some cases, a large number of false positive "First Ingress Authentication from Country" and “Bruteforce from Unknown Source” alerts were generated.
- Some “Ingress From Disabled Account” alerts that should have fired, did not.
- Some alert modifications for the above alerts may not have been applied.
Our response and next steps:
Rapid7 Engineering teams are working on a fix to revert all users that were incorrectly labeled as “Removed” to their original “Active” status.
We will continue to update the status page with the latest information.
Jan 18, 2023 - 20:25 UTC
Identified - The issue has been identified and a fix is being implemented.
Jan 17, 2023 - 13:33 UTC
Jan 17, 2023 - 13:33 UTC
Update - We are continuing to investigate this issue.
Jan 17, 2023 - 11:25 UTC
Jan 17, 2023 - 11:25 UTC
Investigating - The team is currently aware of an issue which is marking some users as "Removed" in IDR.
We are working on identifying and fixing the issue so that the statuses of those "Removed" users are reset correctly.
Jan 17, 2023 - 11:25 UTC
We are working on identifying and fixing the issue so that the statuses of those "Removed" users are reset correctly.
Jan 17, 2023 - 11:25 UTC
InsightIDR (US1)
Partial Outage
User Interface
Partial Outage
Event Collection
Operational
Event Processing
Partial Outage
API
Partial Outage
InsightIDR (US2)
Partial Outage
User Interface
Partial Outage
Event Collection
Operational
Event Processing
Partial Outage
API
Partial Outage
InsightIDR (US3)
Partial Outage
User Interface
Partial Outage
Event Collection
Operational
Event Processing
Partial Outage
API
Partial Outage
InsightIDR (CA)
Partial Outage
User Interface
Partial Outage
Event Collection
Operational
Event Processing
Partial Outage
API
Partial Outage
InsightIDR (EU)
Partial Outage
User Interface
Partial Outage
Event Collection
Operational
Event Processing
Partial Outage
API
Partial Outage
InsightIDR (AU)
Partial Outage
User Interface
Partial Outage
Event Collection
Operational
Event Processing
Partial Outage
API
Partial Outage
InsightIDR (AP)
Partial Outage
User Interface
Partial Outage
Event Collection
Operational
Event Processing
Partial Outage
API
Partial Outage
InsightOps (US1)
Operational
User Interface
Operational
Data Ingestion
Operational
Alerting
Operational
InsightOps (US2)
Operational
User Interface
Operational
Data Ingestion
Operational
Alerting
Operational
InsightOps (US3)
Operational
User Interface
Operational
Data Ingestion
Operational
Alerting
Operational
InsightOps (CA)
Operational
User Interface
Operational
Data Ingestion
Operational
Alerting
Operational
InsightOps (EU) / Logentries
Operational
User Interface
Operational
Data Ingestion
?
Operational
Alerting
Operational
InsightOps (AU)
Operational
User Interface
Operational
Data Ingestion
Operational
Alerting
Operational
InsightOps (AP)
Operational
User Interface
Operational
Data Ingestion
Operational
Alerting
Operational
InsightVM (US1)
Operational
User Interface
Operational
Event Collection
Operational
Event Processing
Operational
InsightVM (US2)
Operational
User Interface
Operational
Event Collection
Operational
Event Processing
Operational
InsightVM (US3)
Operational
User Interface
Operational
Event Collection
Operational
Event Processing
Operational
InsightVM (CA)
Operational
User Interface
Operational
Event Collection
Operational
Event Processing
Operational
InsightVM (EU)
Operational
User Interface
Operational
Event Collection
Operational
Event Processing
Operational
InsightVM (AP)
Operational
User Interface
Operational
Event Collection
Operational
Event Processing
Operational
InsightVM (AU)
Operational
User Interface
Operational
Event Collection
Operational
Event Processing
Operational
AppSpider
Operational
AppSpider OnDemand
?
Operational
Webscantest.com
?
Operational
Hackazon
?
Operational
InsightAppSec (US1)
Operational
User Interface
Operational
Scheduling
Operational
Cloud Engines
Operational
API
Operational
Data Ingestion
Operational
InsightAppSec (US2)
Operational
User Interface
Operational
Scheduling
Operational
Cloud Engines
Operational
API
Operational
Data Ingestion
Operational
InsightAppSec (US3)
Operational
User Interface
Operational
Scheduling
Operational
Cloud Engines
Operational
API
Operational
Data Ingestion
Operational
InsightAppSec (CA)
Operational
User Interface
Operational
Scheduling
Operational
Cloud Engines
Operational
API
Operational
Data Ingestion
Operational
InsightAppSec (EU)
Operational
User Interface
Operational
Scheduling
Operational
Cloud Engines
Operational
API
Operational
Data Ingestion
Operational
InsightAppSec (AU)
Operational
User Interface
Operational
Scheduling
Operational
Cloud Engines
Operational
API
Operational
Data Ingestion
Operational
InsightAppSec (AP)
Operational
User Interface
Operational
Scheduling
Operational
Cloud Engines
Operational
API
Operational
Data Ingestion
Operational
InsightCloudSec (US1)
Operational
User Interface
Operational
Data Ingestion
Operational
InsightCloudSec (EU)
Operational
User Interface
Operational
Data Ingestion
Operational
InsightCloudSec (AP)
Operational
User Interface
Operational
Data Ingestion
Operational
InsightCloudSec (AU)
Operational
User Interface
Operational
Data Ingestion
Operational
InsightConnect (US1)
Operational
User Interface
Operational
Workflow Execution
Operational
API
Operational
Data Ingestion
Operational
InsightConnect (US2)
Operational
User Interface
Operational
Workflow Execution
Operational
API
Operational
InsightConnect (US3)
Operational
User Interface
Operational
Workflow Execution
Operational
API
Operational
InsightConnect (EU)
Operational
User Interface
Operational
Workflow Execution
Operational
API
Operational
InsightConnect (CA)
Operational
User Interface
Operational
Workflow Execution
Operational
API
Operational
InsightConnect (AU)
Operational
User Interface
Operational
Workflow Execution
Operational
API
Operational
InsightConnect (AP)
Operational
User Interface
Operational
Workflow Execution
Operational
API
Operational
tCell (US1)
Operational
User Interface
Operational
Event Processing
Operational
API
Operational
Notifications
Operational
tCell (US2)
Operational
User Interface
Operational
Event Processing
Operational
API
Operational
Notifications
Operational
tCell (US3)
Operational
User Interface
Operational
Event Processing
Operational
API
Operational
Notifications
Operational
tCell (EU)
Operational
User Interface
Operational
Event Processing
Operational
API
Operational
Notifications
Operational
tCell (AU)
Operational
User Interface
Operational
Event Processing
Operational
API
Operational
Notifications
Operational
Rapid7 Services (US1)
Operational
Rapid7 Services (US2)
Operational
Rapid7 Services (US3)
Operational
Rapid7 Services (EU)
Operational
Rapid7 Services (AP)
Operational
Rapid7 Services (CA)
Operational
Rapid7 Services (AU)
Operational
Extension Library
?
Operational
Discuss Forum
?
Operational
Operational
Degraded Performance
Partial Outage
Major Outage
Maintenance
Scheduled Maintenance
InsightIDR AP, AU - Scheduled Maintenance
Feb 6, 2023 18:00-19:00 UTC
Update -
We will be undergoing scheduled maintenance during this time.
Feb 03, 2023 - 15:26 UTC
Feb 03, 2023 - 15:26 UTC
Update -
We will be undergoing scheduled maintenance during this time.
Feb 03, 2023 - 15:24 UTC
Feb 03, 2023 - 15:24 UTC
Scheduled -
InsightIDR maintenance is scheduled at 18:00 UTC (1pm US ET) Monday, February 6. IDR will still be collecting events during this window, however there may be disruptions to the user interface home page, some subpages, and to alerting. Some APIs may be affected as well. No data loss will be occur and all alerts will be processed after maintenance is complete.
Feb 03, 2023 - 15:20 UTC
Feb 03, 2023 - 15:20 UTC
InsightIDR US, EU, CA - Scheduled Maintenance
Feb 7, 2023 02:00-03:00 UTC
Update -
We will be undergoing scheduled maintenance during this time.
Feb 03, 2023 - 15:25 UTC
Feb 03, 2023 - 15:25 UTC
Scheduled -
InsightIDR maintenance is scheduled at 2:00 UTC (9pm US ET) Tuesday, February 7. IDR will still be collecting events during this window, however there may be disruptions to the user interface home page, some subpages, and to alerting. Some APIs may be affected as well. No data loss will be occur and all alerts will be processed after maintenance is complete.
Feb 03, 2023 - 15:22 UTC
Feb 03, 2023 - 15:22 UTC
Platform Sensor Management Scheduled Maintenance (All Regions)
Feb 7, 2023 09:00-12:00 UTC
Sensor Management will undergo maintenance in all regions. During that time management actions on Insight Sensors may be impacted.
Posted on Feb 02, 2023 - 17:16 UTC
Posted on Feb 02, 2023 - 17:16 UTC
InsightVM - AP - Scheduled Maintenance
Feb 7, 2023 17:00-21:00 UTC
Update -
We will be undergoing scheduled maintenance during this time.
Feb 01, 2023 - 21:57 UTC
Feb 01, 2023 - 21:57 UTC
Scheduled -
New asset data from agents and scans will be delayed by up to 3 - 5 hours. Goals and Remediation Projects will not be updated during this time. Some pages and dashboard cards may fail to load
Feb 01, 2023 - 21:54 UTC
Feb 01, 2023 - 21:54 UTC
InsightVM - CA - Scheduled Maintenance
Feb 7, 2023 22:00 - Feb 8, 2023 02:00 UTC
New asset data from agents and scans will be delayed by up to 3 - 5 hours. Goals and Remediation Projects will not be updated during this time. Some pages and dashboard cards may fail to load.
Posted on Feb 01, 2023 - 22:05 UTC
Posted on Feb 01, 2023 - 22:05 UTC
InsightVM - AU - Scheduled Maintenance
Feb 8, 2023 17:00-21:00 UTC
New asset data from agents and scans will be delayed by up to 3 - 5 hours. Goals and Remediation Projects will not be updated during this time. Some pages and dashboard cards may fail to load.
Posted on Feb 01, 2023 - 22:07 UTC
Posted on Feb 01, 2023 - 22:07 UTC
InsightVM - US3 - Scheduled Maintenance
Feb 8, 2023 22:00 - Feb 9, 2023 02:00 UTC
New asset data from agents and scans will be delayed by up to 3 - 5 hours. Goals and Remediation Projects will not be updated during this time. Some pages and dashboard cards may fail to load.
Posted on Feb 01, 2023 - 22:08 UTC
Posted on Feb 01, 2023 - 22:08 UTC
InsightVM - EU - Scheduled Maintenance
Feb 9, 2023 17:00-21:00 UTC
New asset data from agents and scans will be delayed by up to 3 - 5 hours. Goals and Remediation Projects will not be updated during this time. Some pages and dashboard cards may fail to load.
Posted on Feb 01, 2023 - 22:12 UTC
Posted on Feb 01, 2023 - 22:12 UTC
InsightVM - US1 - Scheduled Maintenance
Feb 9, 2023 22:00 - Feb 10, 2023 02:00 UTC
New asset data from agents and scans will be delayed by up to 3 - 5 hours. Goals and Remediation Projects will not be updated during this time. Some pages and dashboard cards may fail to load.
Posted on Feb 01, 2023 - 22:13 UTC
Posted on Feb 01, 2023 - 22:13 UTC
InsightVM - US2 - Scheduled Maintenance
Feb 10, 2023 21:00 - Feb 11, 2023 01:00 UTC
New asset data from agents and scans will be delayed by up to 3 - 5 hours. Goals and Remediation Projects will not be updated during this time. Some pages and dashboard cards may fail to load.
Posted on Feb 01, 2023 - 22:14 UTC
Posted on Feb 01, 2023 - 22:14 UTC