Getting a Data Dump

Overview

Important: At the moment, this tool must be run by a developer, because the data files have to be manually downloaded and then uploaded to send to the client.

An Elite Data Dump is the entire contents of the Insights (MySQL) database, sent in either CSV format or MySQL backup. All the binary files/documents/attachments are optionally included as well.

Procedures

1. Project Manager (PM) contacts the Core Developers to get a Core Developer (CD) to be assigned to the project.
2. PM specifies the Elite Cluster, TenantId, and the email addresses of the people who should receive the data.
3. Since a dump takes a "snapshot" of the data at a certain point in time, the PM sets a date and time at which the dump should take place. 
4. CD executes the dump and sends the data files via MediaShuttle to the appropriate email addresses, and a confirmation email message (see Appendix A for an example). Be sure to CC the PM.
5. The client receives emails from MediaShuttle with download links that expire after 30 days.

Communications to the client

• Watch for a set of emails from MediaShuttle and use the links in the emails to download the data.
• The links will expire in 30 days; if they need it sent again after that time it will entail doing the project over again.
• Use the Insights documentation to understand the data; start with Elite Data Dump.
• Please contact the support team for any questions about to interpret or query the data.

Internal communications

• If the client has questions about where to find data, the first line of support is the Insights folks on the support team, because most questions will be about where to find certain data -- which view etc.
• If we find that we are getting the same questions over and over, we should discuss how to improve the Insights documentation and this article.
• If we find that some important data is entirely missing and not available in Insights, we should propose changes to the Insights data for an upcoming Elite sprint.

Appendices

Appendix A: Client email

Hi ______,

You should shortly receive an email from MediaShuttle, the service we use to securely send large amounts of sensitive data. The links to download this data will be available for approximately 30 days. Please download the files as soon as you can.

See this article to understand how to interpret the data: https://help-insights.venueops.com/articles/dump.html

Please let us know if you have any questions or issues!