How does it work?

MagNumDB is a database that contains about 350,000 items. These items are constants, names, values all extracted from more than 6,000 header files (.h, .hxx, .hpp, .idl, etc.) provided by standard Windows and Visual Studio SDKs and WDKs.

Some values have been extracted from the very special uuid.lib file that contains the value of thousands of guids and property keys, not present anywhere else in header files. This can explain some duplicates (because names in uuid.lib are not always exactly the same as names in .h parsed files...).

It also contains around 36,0000 undocumented guids that we found ... meeeeep ...

 "C2P5"

To build this database, we have tried many existing parsers, things like CLANG or other fine tools, but they just don't suit our needs. They can't handle thousands of files that don't compile together, they can't handle some specific (or just very old) Microsoft constructs or annotations, they don't remember the stack of #define directives that led to a definition, they only give you a final AST, not a partial one, etc.

So, in the end, we have written a C/C++ parser named C2P5 (for C/CPP/PreProcessor/Parser), tailored specifically for computing constants. C2P5 is capable of preprocessing, parsing and partially evaluating all header files as if they were included in a one big virtual project (that of course, does not compile) on a 32G RAM machine. It currently supports the following preprocessor and C/C++ constructs:

  • #define preprocessor that define constants
  • #define preprocessor that define expression to compute constants
  • C and C++ constants, strings and enum definitions, and some level of pointerness
  • Special GUID constructs like DECLSPEC_UUID, DEFINE_GUIDSTRUCT, MIDL_INTERFACE, you name it
  • PROPERTYKEY constructs
  • Some IDL constructs
  • Etc.

The parser remembers dynamic preprocessor definitions (#if, #ifdef, etc.) that are conditions for constants definitions and expression computation. All parsed items are saved in the database, as well as the associated conditions. There may be more than one item corresponding to a given name, if there are differences in their associated conditions stack.

C2P5 supports the following types of constants, regardless of the way they are defined in source files:

  • integer, signed or unsigned, from 8-bit to 128-bit
  • floating point number, single (32-bit) or double (64-bit)
  • globally unique identifier, or guid, uuid, CLSID, IID, etc.
  • string, in narrow, wide, or utf-8/16/32 formats
  • character, in narrow, wide, or utf-8/16/32 formats
  • pointer, a constant cast as a pointer
  • property key, or PROPERTYKEY, or PKEY, a combination of a guid (fmtid) and a 32-bit integer (id).

 Powered by

C2P5 and this MagNumDB web site are written in C# and use a Lucene database as a full-text search engine. C2P5 uses a custom ANTLR4cs C grammar for expression parsing, not for preprocessor parsing.

 

 Frequently Asked Questions

  • Q: Can I run custom queries?
    A: Yes. You can use Lucene's query syntax. Note the Database is case insensitive. Check out the list of columns with their corresponding database column names:

    • Index: the item's index.
    • Name: the item's name, or title. For enum values, it's prefixed with the enum's name.
      Corresponding database field: title.
    • Type: the item's type, expressed in a specific, universal system.
      Corresponding database's field: valuetype, but use the value of the Storage type column for queries on items type.
    • Value: the item's value. For string values, it's displayed as is w/o quotes nor escaping.
      Corresponding database field: value. There is also a typedvalue field that can contain database's Int32, Int64, Float, Double or String typed values.
    • Hex Value: the item's hexadecimal value, only valid for integer types.
      There is no corresponding database field.
    • Signed Value: the item's signed value, only valid for integer and double types. Useful when you found a unsigned number and want to get the corresponding signed value (uint -> int for example).
      There is no corresponding database field.
    • Source lines(s): the source lines from which the item was extracted. Comments and characters such as TAB, CR are preserved.
      Corresponding database field: source.
    • File path: the file path from which the item was extracted, terminated by the line index.
      Corresponding database field: filepath. There are also directory and filename fields. filename is useful to query for values in a given file.
    • Score: Database's score value. Items are returned sorted by score.
    • Guid formats: a utility columns that proposes all possible guid formats. Only valid for guid types.
      There is no corresponding database field
    • Char type: the character encoding (narrow, wide, etc.). Only valid for char and string values.
      Corresponding database field: chartype.
    • Storage type: the exact storage type in the database. Only used for specific queries.
      Corresponding database field: valuetype.
    • Conditions: the list of preprocessor conditions for a given item. If a condition is surrounded with a REVERSE function, it means the reverse condition of what's surrounded was the condition.
      Corresponding database field: conditions. There may be multiple conditions fields for one item.

    Some important points to note:

    • If you search for a negative number (like error codes expressed using signed integers), you can surround the search with double quotes, for example searching for "-2147009290" is equivalent to searching for 0x80073CF6, 80073CF6 (or even 3CF6 in this specific case). If you don't surround negative numbers with double quotes, the system will search for signed and unsigned corresponding values.
    • The full-text search uses items' name, value, hex value, guid formats, source lines, etc. so refine your search if you get back too many items.
    • You can search for guid binary values using just a part of their full definition. For example, if you search for '79eac9c5', it will get you 3 guid entries
    • Leading wild card search (*whatever) is allowed, but it may slow down the search significantly.

    Here are some example or custom queries:

    title:wm_user returns the WM_USER Windows message item, not all items that reference the WM_USER token.

    title:wm_u* returns all items (Windows messages probably) whose name starts with WM_U*.

    value:1024 AND title:wm_* returns all items (Windows messages probably) whose name starts with WM_U* and value is 1024. Note AND must be UPPERCASE for database to understand it as an AND operator.

    value:"00000002-0000-0000-C000-000000000046" returns the IMalloc IID guid value.

  • Q: I always get back 400 items at most. Why?
    A: The MagNumDb site currently limits the number of returned items to this value by design. This should be enough for most real search scenarios (like enums with a big list of values).

  • Q: Some values are empty. Why?
    A: The expression evaluator cannot always compute the final value, because it sometimes require contextual information (custom defines, compiler architecture, etc.) that the parser doesn't have at parsing time. You can enable the Source line(s) column to check what's the corresponding source and try to work it out by yourself. The origin file path and line number is also included.

  • Q: Can I get all values for a given enum?
    A: Sure. For example, __VSHPROPID is the name of an enum, and a query like this: parent:__VSHPROPID will get all the enum's values (66 entries).

  • Q: I sometimes get back items whose name starts with "__magnumdb__enum_". Why?
    A: C allows unnamed enums. The MagNumDb parser just gives them a name, using the defining file name and a counter.

  • Q: I sometimes get back the same item/name twice or more with different values. For example:  TARGET_IS_NT60_OR_LATER. Why?
    A: This can be the case with defines. Their value may be different if they were surrounded by # directives (#if, #else, etc.) in the original source code. You can enable the Condition(s) column to check what are the corresponding conditions for a given item.
    Note: if a condition is surrounded with a funny REVERSE function token, it means the reverse condition of what's surrounded.

 Database Metrics

  • Last update date: Thursday May 13, 2020
  • Items count: 340878
  • Parsed files count: 8447
  • Windows SDK version: 10.0.19041.0
  • NetFx SDK version: 4.8
  • MSVC Tools version: 14.25.28610

 Rest API

There is a JSON version API (you will have to figure out the schema, it's pretty obvious) that you can call here (the search query is the 'q' parameter):

   https://www.magnumdb.com/api.aspx?q=0xC000000D&key=you-api-key-goes-here

Note this API also has a 400 items maximum limit and the server is monitored for excessive usage (the key can be removed without notice). If you want to get a key, send us an email.

 

 Contact

We welcome feedback.
Seen anything missing? A bug? A wrong value? Do you have any suggestion for improvements? Do you have an idea for a cool new feature?

Please contact us here

 About MagNumDB

MagNumDB  2017-2021 Simon Mourier V1.3.2. All rights reserved.

Profile for Simon Mourier at Stack Overflow, Q&A for professional and enthusiast programmers


All product names, logos, and brands are property of their respective owners. All company, product and service names used in this website are for identification purposes only.

All values, names, source code fragments displayed here have been extracted from files that are property of their respective owners.

THIS SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND OTHER THAN AS SPECIFICALLY SET FORTH IN THE LICENSE AGREEMENT, INCLUDING WITHOUT LIMITATION WARRANTIES OF MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE AND NON-INFRINGEMENT. IN NO EVENT SHALL THE AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER LIABILITY, WHETHER IN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM, OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE SOFTWARE.

Index Score Name Type Value Hex value Signed value Guid formats Char type Storage type Source line(s) File path Condition(s)
Index Score Name Type Value Hex value Signed value Guid formats Char type Storage type Source line(s) File path Condition(s)
1 5.519186 SZ_CONTENTTYPE_HTMLA String text/html Narrow System.TypedString
#define SZ_CONTENTTYPE_HTMLA       "text/html"
%ProgramFiles(x86)%\Windows Kits\10\Include\10.0.19041.0\um\shlwapi.h(459,0)
  • Ifndef NOSHLWAPI
  • Ifndef NO_SHLWAPI_STRFCNS
  • If WINAPI_FAMILY_PARTITION(WINAPI_PARTITION_DESKTOP)
2 5.519186 AppointmentDetailsKind::Html Int32 1 0x00000001 1 System.Int32
Html      = 1
%ProgramFiles(x86)%\Windows Kits\10\Include\10.0.19041.0\winrt\Windows.ApplicationModel.appointments.idl(346,0)
3 5.519186 EmailMailboxAutoReplyMessageResponseKind::Html Int32 0 0x00000000 0 System.Int32
Html      = 0,
%ProgramFiles(x86)%\Windows Kits\10\Include\10.0.19041.0\winrt\Windows.ApplicationModel.email.idl(526,0)
4 4.599321 CFSTR_MIME_HTML String text/html Narrow System.TypedString
#define CFSTR_MIME_HTML         (TEXT("text/html"))
%ProgramFiles(x86)%\Windows Kits\10\Include\10.0.19041.0\um\urlmon.h(692,0)
  • If WINAPI_FAMILY_PARTITION(WINAPI_PARTITION_APP | WINAPI_PARTITION_SYSTEM)
5 4.599321 SZ_IE_DEFAULT_HTML_EDITOR String Default HTML Editor Narrow System.TypedString
#define SZ_IE_DEFAULT_HTML_EDITOR       "Default HTML Editor"
%ProgramFiles(x86)%\Windows Kits\10\Include\10.0.19041.0\um\InetReg.h(109,0)
  • If WINAPI_FAMILY_PARTITION(WINAPI_PARTITION_DESKTOP)
6 4.599321 cdoTextHTML String text/html Wide System.TypedString
#define cdoTextHTML	L"text/html"
%ProgramFiles(x86)%\Windows Kits\10\Include\10.0.19041.0\um\cdosysstr.h(74,0)
7 4.599321 SZ_CONTENTTYPE_HTMLW String text/html Wide System.TypedString
#define SZ_CONTENTTYPE_HTMLW       L"text/html"
%ProgramFiles(x86)%\Windows Kits\10\Include\10.0.19041.0\um\shlwapi.h(460,0)
  • Ifndef NOSHLWAPI
  • Ifndef NO_SHLWAPI_STRFCNS
  • If WINAPI_FAMILY_PARTITION(WINAPI_PARTITION_DESKTOP)
8 3.902653 SZ_CONTENTTYPE_HTML String text/html Wide System.TypedString
#define SZ_CONTENTTYPE_HTML     SZ_CONTENTTYPE_HTMLW
%ProgramFiles(x86)%\Windows Kits\10\Include\10.0.19041.0\um\shlwapi.h(465,0)
  • Ifndef NOSHLWAPI
  • Ifndef NO_SHLWAPI_STRFCNS
  • If WINAPI_FAMILY_PARTITION(WINAPI_PARTITION_DESKTOP)
  • Ifdef UNICODE
9 3.902653 SZ_CONTENTTYPE_HTML String text/html Narrow System.TypedString
#define SZ_CONTENTTYPE_HTML     SZ_CONTENTTYPE_HTMLA
%ProgramFiles(x86)%\Windows Kits\10\Include\10.0.19041.0\um\shlwapi.h(468,0)
  • Ifndef NOSHLWAPI
  • Ifndef NO_SHLWAPI_STRFCNS
  • If WINAPI_FAMILY_PARTITION(WINAPI_PARTITION_DESKTOP)
  • REVERSE(Ifdef UNICODE)
10 3.252211 REGSTR_KEY_DEFAULT_HTML_EDITOR String Default HTML Editor Narrow System.TypedString
#define REGSTR_KEY_DEFAULT_HTML_EDITOR  TEXT(SZ_IE_DEFAULT_HTML_EDITOR)
%ProgramFiles(x86)%\Windows Kits\10\Include\10.0.19041.0\um\InetReg.h(111,0)
  • If WINAPI_FAMILY_PARTITION(WINAPI_PARTITION_DESKTOP)
11 3.252211 SyndicationTextType Enum
enum SyndicationTextType
            {
                Text  = 0,
                Html  = 1,
                Xhtml = 2
            };
%ProgramFiles(x86)%\Windows Kits\10\Include\10.0.19041.0\winrt\windows.web.syndication.idl(265,0)
12 3.252211 AppointmentDetailsKind Enum
enum AppointmentDetailsKind
            {
                PlainText = 0,
                Html      = 1
            };
%ProgramFiles(x86)%\Windows Kits\10\Include\10.0.19041.0\winrt\Windows.ApplicationModel.appointments.idl(343,0)
13 3.252211 EmailMailboxAutoReplyMessageResponseKind Enum
enum EmailMailboxAutoReplyMessageResponseKind
            {
                Html      = 0,
                PlainText = 1
            };
%ProgramFiles(x86)%\Windows Kits\10\Include\10.0.19041.0\winrt\Windows.ApplicationModel.email.idl(524,0)
14 3.252211 EmailMessageBodyKind Enum
enum EmailMessageBodyKind
            {
                Html      = 0,
                PlainText = 1
            };
%ProgramFiles(x86)%\Windows Kits\10\Include\10.0.19041.0\winrt\Windows.ApplicationModel.email.idl(633,0)
15 3.252211 UserDataTaskDetailsKind Enum
enum UserDataTaskDetailsKind
            {
                PlainText = 0,
                Html      = 1
            };
%ProgramFiles(x86)%\Windows Kits\10\Include\10.0.19041.0\winrt\Windows.ApplicationModel.userdatatasks.idl(180,0)
16 3.252211 cmdidShowPages Int32 200 0x000000C8 -56 System.Int32
#define cmdidShowPages          200 // Show HTML pages
%ProgramFiles(x86)%\Microsoft Visual Studio\2019\Professional\VSSDK\VisualStudioIntegration\Common\Inc\stdidcmd.h(306,0)
17 3.252211 msoftfHtml Int32 1024 0x00000400 1024 System.Int32
#define msoftfHtml					0x00000400		// HTML type
%ProgramFiles(x86)%\Microsoft Visual Studio\2019\Professional\VSSDK\VisualStudioIntegration\Common\Inc\office10\msodm.h(546,0)
18 3.252211 __magnumdb__enum_msodm_h_21::msoioltdiHtml Int32 10 0x0000000A 10 System.Int32
msoioltdiHtml,								// Set if redirect detects as HTML
%ProgramFiles(x86)%\Microsoft Visual Studio\2019\Professional\VSSDK\VisualStudioIntegration\Common\Inc\office10\msodm.h(711,0)
19 2.601769 HHWIN_PROP_CHANGE_TITLE Int32 8192 0x00002000 8192 System.Int32
#define HHWIN_PROP_CHANGE_TITLE     (1 << 13)   // Put current HTML title in title bar
%ProgramFiles(x86)%\Windows Kits\10\Include\10.0.19041.0\um\HtmlHelp.h(81,0)
  • If WINAPI_FAMILY_PARTITION(WINAPI_PARTITION_DESKTOP)
20 2.601769 IMSGFLAGS::IMF_HTML Int32 16 0x00000010 16 System.Int32
IMF_HTML           = 0x00000010,   // The message has a text/html body
%ProgramFiles(x86)%\Windows Kits\10\Include\10.0.19041.0\um\mimeole.idl(2113,0)
21 2.601769 IMSGFLAGS::IMF_MHTML Int32 1024 0x00000400 1024 System.Int32
IMF_MHTML          = 0x00000400,   // The message has a MIME-HTML multipart/related section
%ProgramFiles(x86)%\Windows Kits\10\Include\10.0.19041.0\um\mimeole.idl(2119,0)
22 2.601769 cmdidInsertHTMLWizard Int32 192 0x000000C0 -64 System.Int32
#define cmdidInsertHTMLWizard       192 // Insert HTML using a Wizard
%ProgramFiles(x86)%\Microsoft Visual Studio\2019\Professional\VSSDK\VisualStudioIntegration\Common\Inc\stdidcmd.h(297,0)
23 2.601769 OIO_SAVE_AS_HTML Int32 64 0x00000040 64 System.Int32
#define OIO_SAVE_AS_HTML        0x0040 // Save the properties in HTML format
%ProgramFiles(x86)%\Microsoft Visual Studio\2019\Professional\VSSDK\VisualStudioIntegration\Common\Inc\office10\msoprops.h(2099,0)
24 2.276548 HLNF_UNTRUSTEDFORDOWNLOAD Int32 33554432 0x02000000 33554432 System.Int32
#define HLNF_UNTRUSTEDFORDOWNLOAD       0x02000000  // Trident is navigating to an untrusted non-html file.  If we try to download it, do not.
%ProgramFiles(x86)%\Windows Kits\10\Include\10.0.19041.0\um\shdeprecated.h(838,0)
  • If WINAPI_FAMILY_PARTITION(WINAPI_PARTITION_DESKTOP)
25 1.951327 Uri_CREATE_PRE_PROCESS_HTML_URI Int32 2048 0x00000800 2048 System.Int32
#define Uri_CREATE_PRE_PROCESS_HTML_URI           0x00000800    // DEFAULT:  Perform pre-processing on the URI to remove control characters and whitespace as if the URI comes from the raw href value of an HTML page.
%ProgramFiles(x86)%\Windows Kits\10\Include\10.0.19041.0\um\urlmon.h(3317,0)
  • If (_WIN32_IE >= _WIN32_IE_IE70)
  • If WINAPI_FAMILY_PARTITION(WINAPI_PARTITION_APP | WINAPI_PARTITION_SYSTEM)
26 1.14983 IMSGFLAGS Enum
typedef enum tagIMSGFLAGS {
            IMF_ATTACHMENTS    = 0x00000001,   // The message has attachments
            IMF_MULTIPART      = 0x00000002,   // The message is a multipart message
            IMF_SUBMULTIPART   = 0x00000004,   // The message has a nested multipart section
            IMF_MIME           = 0x00000008,   // The message is in MIME format
            IMF_HTML           = 0x00000010,   // The message has a text/html body
            IMF_PLAIN          = 0x00000020,   // The message has a text/plain body
            IMF_PARTIAL        = 0x00000040,   // The message has un-matching boundaries, or is a message/partial
            IMF_SIGNED         = 0x00000080,   // The message is signed
            IMF_ENCRYPTED      = 0x00000100,   // The message is secured
            IMF_TNEF           = 0x00000200,   // The message has a Microsoft TNEF attachment
            IMF_MHTML          = 0x00000400,   // The message has a MIME-HTML multipart/related section
            IMF_SECURE         = 0x00000800,   // The message has a cryptographic enhancement
            IMF_TEXT           = 0x00001000,   // The message contains text/xxx part(s)
            IMF_CSETTAGGED     = 0x00002000,   // The message was tagged with a charset
            IMF_NEWS           = 0x00004000,   // The message has nntp (news) headers (Newsgroup, Path, etc)
            IMF_VOICEMAIL      = 0x00008000,   // The message has the X-Voicemail Header Set to something
            IMF_HASVCARD       = 0x00010000,   // The message has a text/v-card attachment.
            IMF_RFC1154        = 0x00020000    // The message was decoded using RFC1154.
        } IMSGFLAGS;
%ProgramFiles(x86)%\Windows Kits\10\Include\10.0.19041.0\um\mimeole.idl(2108,0)
27 0.9756634 __magnumdb__enum_msodm_h_21 Enum
enum
	{
	msoioltdiFirst					=	1,
	msoioltdiAttr					=	1,		// Document attributes
	msoioltdiCPagesPrinted,					// Count of pages printed during the
	msoioltdiDcPagesPrinted,				// Change in the count of pages printed
	msoioltdiModeIStorage,					// Open mode used with an IStorage
	msoioltdiOWSStgError,					// The document opened for RW on OWS gave
	msoioltdiReDownload,						// Set this to force OLDoc to redownload the web document
	msoioltdiRedirected,						// If this is set (usually after a call to GetFilePath (for urls)
	msoioltdiEnableRedirect,				// This flag determines whether or not redirect is allowed.
	msoioltdiSniffed,							// Set if we sniffed the file type.
	msoioltdiHtml,								// Set if redirect detects as HTML
	msoioltdiMHtml,							// Set if redirect detects as MHTML
	msoioltdiXml,						// Set if redirect detects as XML
	msoioltdiUseDefaultFolderSuffix,    // Set if app overrides existing folder
	msoioltdiCodepage,						// The codepage of the document
	msoioltdiOWSLowDateTime,				// dwLowDateTime for OWS Urls
	msoioltdiOWSHighDateTime,				// dwHighDateTime for OWS Urls
	msoioltdiURLSyntax,					// The URL syntax of the Persistent Name
	msoioltdiEnableCheckout,				// Enable checkout on open
	msoioltdiDelayedCancel,					// Set by OLDoc to abort current operation in a command which cannot
	msoioltdiNoASPRedirection,
	msoioltdiLim
	};
%ProgramFiles(x86)%\Microsoft Visual Studio\2019\Professional\VSSDK\VisualStudioIntegration\Common\Inc\office10\msodm.h(678,0)