Subscribe to GEN
Login to GEN
Big Data, is a blanket term that's been in circulation for a good few years now, but what is Big about the Data? Read our Article on what Big Data is.
Big Data is the process of taking some starting data, like your CRM customer data, and then cross-referencing that with 'Large' datasets, such as your sales data, or public data such as census, financial, social, demographic, etc and then returning your data enhanced with these other datasets.
A common theme in big data, is marketing, where you provide a list of customers, and we try and match those to specific targets perhaps based on affluence, or house price, or financial status, returning that to you with these additional attributes.
Another is Deep Analysis, where you supply a mass of detail data, such as all the buying activity for all customers and we will then analyse this data rendering it into 'feature' sets, for example, all customers who purchased a certain product or type of product and their socioeconomic backgrounds.
At the heart of our Big Data Operation is our Serenity Data Cluster, a distributed cluster of high end
servers running
a selection of platforms which can easily process large datasets very quickly, and are hosted in the UK
making them GDPR safe. As an example, at the time of writing we
are processing 38 million sales transaction records against the UK census data, and linking in customer
satisfaction data
to provide intelligence to our client. This process took 4 minutes to return the data.
That is 38 million sales records, 50 million census records, 33 thousand customer surveys, in 4 minutes.
Many Systems do not take full advantage of the inherent data to help drive intelligence lead decision making. It is surprising how much 'detail' can be hidden in the data, and our data science team are specialists in this area.
All of these APIs and more are available to consume in your application, or, GEN offer a managed big data platform to take a dataset from you, do all the processing and return the results, via API, SFTP, WebDAV or secure storage.
GEN have an API platform that provides access to a wide range of data sources, providing the information in a standard format for consumption in server-side applications. APIs are authorised with Keys and full request tracking and billing is available. Some of the more popular APIs are:
This for any given postcode and optional UPRN will provide a list of available broadband speeds and services from OpenReach. This can be used to provide an address dropdown, which can then provide coverage data into your web app. With this API you can determine the broadband services available via OpenReach at any UK address, and know the expected performance.
For a given telephone number, pull the telecommunications provider and other provider information. This can be used to determine if the number is likely valid, and who is operating this number. We call this a CNAM lookup.
This for any given postcode and optional UPRN will provide a map of signal strength values for the major UK mobile network operators. This can be used to assess the indoor and outdoor coverage, which can be used to determine which mobile network will provide the best service, or whether an address has substandard or non-existant coverage.
This for any given postcode will provide the latitude and longitude, city, county, ward, local authority and more information, which can then be used to complete a postcode lookup in your web app. This API by itself doesn't provide full address data, instead providing adjunct data to the APIs above to complete the full postal address for a given postcode.
We have API's that can perform live validations on UK Phone Numbers, Postcodes, Email Addresses, as well as many common constructs. Proper live validation especially in webforms can provide a smoother experience, and prevent invalid submissions, and offline validation can clean lists and retain data value.
For a given postcode, pull census data such as income, population, ethnicity, type, employment, and more.
For a given postcode, pull HPI data such as average house prices, median house prices, property prices, and more. When combined with Census data, this can provide invaluable information to select or subselect datasets based on postcode for research, sales and marketing.
Pull the contents of a website, with or without format stripping, and capture a screen shot of the page returned as a base64 encoded image.
Submit queries to our resident AI models, allowing data to be converted, analysed, and exchanged. You can use the APIs to handle pretty much anything covered by large language models, such as converting audio to a transcript, summarising or analysing documents, and much more.
For a given postcode, pull affluence data such as income brackets, median income, and more. Combine this with Census and HPI data to profile postcodes for research, sales and marketing.
Pull realtime exchange rates from countries across the world, to do realtime currency conversions in your web apps or applications.
If you're interested in exploring what hidden patterns you can uncover within your own data, just contact us and let us provide some options.