These calculations help your users understand ways to travel through (or ‘traverse’) a network.

The distance function measures how many hops apart two nodes are in a network. Shortest path highlights the route that passes through the lowest number of nodes.

Hops can also be weighted, meaning you can calculate actual distances, as well as the number of hops.

Wikipedia

Uses Louvain method for finding communities in large networks as described in [Blondel et. al, 2008]. The main concept is that of network modularity that assesses the quality of the current community partition. The algorithm works by successively improving the network's modularity by trying to change the community that each node belongs to. If there is no improvement in modularity this means that the best community partition has been found.

Wikipedia

Uses Double Metaphone phonetic encoding algorithm to find potentially duplicate entities.

Wikipedia

This is the measure that helps you find the nodes that are closest to the other nodes in a network, based on their ability to reach them.

To calculate this, the algorithm finds the shortest path between each node, then assigns each node a score based on the sum of all the paths.

Nodes with a high closeness value have a lower distance to all other nodes. They’d be efficient broadcasters of information.

Wikipedia

Nodes with a high betweenness centrality score are the ones that most frequently act as ‘bridges’ between other nodes. They form the shortest pathways of communication within the network.

Usually this would indicate important gatekeepers of information between groups.

Wikipedia

Nodes with a high degree centrality have the best connections to those around them – they might be influential, or just strategically well-placed.

Wikipedia

• Mandatory:

  • host:
    • Linux
    • Windows (not tested but should work)
  • target:
    • Linux (services)
    • Google Chrome web browser
  • .NET Core SDK v5.0
  • integrated development environment:
    • Visual Studio Code (Linux or Windows)
    • JetBrains Rider (Linux or Windows)
    • Visual Studio (Windows)
  • nodejs
  • git
  • Google Chrome web browser
    • primary web client
    • does not work with Apache ActiveMQ admin page
  • Firefox web browser
    • required to view Apache ActiveMQ admin page
  • database:
    • Microsoft SQL Server
    • MySQL or MariaDB
    • PostgreSQL
    • SQLite (local development only)
  • message queue:
    • Apache ActiveMQ
  • results store:
    • Redis

• Optional

  • Git Extensions (Windows)
  • Docker (Windows)
  • SwitchStartupProject for VS 2019 (Visual Studio)
  • npm
  • Redis Commander
  • DBeaver
  • DB Browser for SQLite
  • SQLiteStudio
  • Microsoft SQL Server Management Studio (Windows)
  • ReportGenerator
  • python
  • Doxygen
  • dot

1. clone repo

  git clone https://github.com/TrevorDArcyEvans/GraphML.git

1. build

  dotnet restore
  dotnet build

1. run tests

  dotnet test

1. run code coverage

  dotnet test /p:CollectCoverage=true /p:CoverletOutputFormat=opencover

1. generate code coverage report

  reportgenerator -reports:**/coverage.opencover.xml -targetdir:./CodeCoverage

1. generate documentation

  doxygen

open documentation

1. run API

  export ASPNETCORE_ENVIRONMENT=Development
  cd GraphML.API/bin/Debug/net5.0 
  ./GraphML.API

1. open Swagger UI
2. start Apache ActiveMQ
3. start Redis
4. run IdentityServer4

  export ASPNETCORE_ENVIRONMENT=Development
  cd IdentityServerAspNetIdentity/bin/Debug/net5.0
  ./IdentityServerAspNetIdentity

1. open IdentityServer4 Login
2. open IdentityServer4 Discovery Document
3. run Analysis Server

  export ASPNETCORE_ENVIRONMENT=Development
  cd GraphML.API/bin/Debug/net5.0 
  ./GraphML.Analysis.Server

1. open Apache ActiveMQ management console
2. start Redis Commander

  redis-commander --port 8080

1. open Redis Commander management console

GraphML.UI.Web

  export ASPNETCORE_ENVIRONMENT=Development
  cd GraphML.UI.Web/bin/Debug/net5.0
  ./GraphML.UI.Web

open https://localhost:5002/

  docker-compose build
  docker-compose up

open https://localhost:5002/

The following components are used to analyse a graph:

• QuikGraph
  • betweeness
  • closeness
  • degree
• Comuna
  • finding communities
• Phonix
  • finding duplicates

• enable Development mode by setting env var:

  export ASPNETCORE_ENVIRONMENT=Development

• authentication (who you are) is handled by IdentityServer
• authorisation (what you can do) is handled by GraphML, based on an email claim
• security is role based, with the following predefined roles:

• the above roles are owned by System organisation
• SwaggerUI is only enabled in Development mode
• SwaggerUI authentication will redirect to a login screen in IdentityServer
• GraphML and IdentityServer4 have some test users:

• add user to GraphML
  • GraphML:./GraphML.Datastore.Database/Data/Import.sql
  • import into database
• add user to IdentityServer4
  • GraphML:./IdentityServerAspNetIdentity/SeedData.cs
  • import into database

    ./IdentityServerAspNetIdentity.exe /seed

A reference browser based GUI is provided. This is written in Blazor and uses the following components:

• Blazor.ContextMenu
• Blazorise
• Blazorise.Bootstrap
• Blazorise.Icons.FontAwesome
• BlazorPro.Spinkit
• BlazorRazor
• BlazorTable
• GraphShape (graph layout)
• MatBlazor
• Z.Blazor.Diagrams (graph visualisation)
• ChartJs.Blazor (timeline visualisation)

At this stage, printing is limited to using the web browser's native printing. Export to PDF (or other formats) is not supported by the current diagramming component (Z.Blazor.Diagrams) but may be possible with other components eg Syncfusion or Blazor.Diagrams. Obviously, replacing such a fundamental component is risky and difficult.

Icons should be 32x32 pixels in size and are resized to this for display.

There are many sources of free or low cost icons on the internet eg:

• flaticon
• Aroma-Free-Icon-Set-For-Designers
• Basal Icons
• Iconshock
• Iconshock-Windows-7
• Onebit
• Ultimate-Free-Web-Designer-Icon-Set
• WooFunction Icons

Real world, large datasets can be obtained from:

• Stanford Large Network Dataset Collection
• IMDb Datasets
• CORD-19: The Covid-19 Open Research Dataset

At this stage, multi-tenancy isolation is implemented in GraphML.Logic:

• GraphML.Logic.Validators
  • does the initial call even make sense
  • only allow calls on items which caller is allowed to access
• GraphML.Logic.Filters
  • only return items relevant to the caller
  • only return items caller is allowed to see

Future work will change to a database-per-client type of isolation which is better suited to high security environments. This will make validators and filters redundnant as all calls are guaranteed to come from the same organisation. In turn, this will make the Organisation entity redundant.

Alternatively, a dedicated deployment per organisation would achieve a similar effect at the expense of managing each deployment.

• How to reattach links
• Deleting link on portless node leaves dangling link - inconsistent with ported node
• No way to interactively create links between portless nodes
• Enhancement request: separate links between same pairs of nodes
• Enhancement request: Would like Diagram.MouseDoubleClick event
• Moving ported nodes programmatically results in links rendered incorrectl
• Enhancement request: Export to PDF
• NavigatorWidget not work with empty Diagram

• HideClearButton has no effect on MatTextField
• Support all Material Icons
• Ability to use own icon packs

You can monitor ActiveMQ using the Web Console by pointing your browser at https://localhost:8161/admin .
From ActiveMQ 5.8 onwards the web apps is secured out of the box.
The default username and password is admin/admin.

There seems to be a problem accessing the Web Console from Google Chrome, so it is recommended to use Firefox (or Microsoft Edge).

Recommended method is to use a Docker container:

  docker pull redis
  docker run -p 6379:6379 redis

Alternate method is to install and run Redis on WSL:

https://redislabs.com/blog/redis-on-windows-10/

  sudo apt install redis-server
  sudo service redis-server status
  sudo service redis-server start
  sudo service redis-server stop

  npm install -g redis-commander
  redis-commander --port 8080

open Redis Commander management console

Pro Tip : to reset the database, use flushdb

This document is best view in Google Chrome with the Markdown Viewer extension. Remember to enable access to file urls in the settings.

• update ranked shortest path to support temporal analysis
  • going forward in time eg for financial transactions or phone calls
  • support DateTimeInterval
  • should be able to transform graph such that links which go backwards in time have infinite weight
  • provide UI to select time attribute
• really improve timeline visualisation
  • probably best to invest in Syncfusion diagramming component (!)
• improve printing/export
  • probably best to invest in Syncfusion diagramming component (!)
• support AMQP
• support other datastores
• unit tests