Smart Energy with a little bit of Seoul.

My visit to Seoul this month was fascinating. The country of Korea built its infrastructure essentially from scratch in the last 50 years, and in doing so was able to use modern technology to challenge some fundamental assumptions that we make in the USA. IP-based telephony predominates based on pervasive free Wi-Fi. Custom tailors use radical outsourcing mediated by IT to provide near-instant services. The National Virtual Power Plant (NVPP) is as up-to-date as any, while using big-data tools in ways not often seen here. There is a desire to embrace the new without fear that seems young and fresh in the way the US often does not. But somehow, the single observation that stays with me is how the use of IT to challenges our assumptions about natural monopolies.

The Seoul Metropolitan Subway system is by far the best I have been on. The signage is unusually good. Many stations have large interactive maps. Every car has digital signs that display the next station in multiple languages. Music plays on the platforms to warn of each impending arrival. In the winter, automatic seat warmers make even the ride itself pleasanter than expected.

The fare system is seamless. The system pioneered in Seoul is now used in many US systems: a card, a wave in, and a wave out, and a charge based on beginning and ending stations. The systems to add money to your fare card will tell you the remaining balance instantly, without inserting the card, or needing to punch buttons. Unlike in the US, every station has prominent stations on which to drop your card and get cash back. The $0.50 deposit on the card itself is just as easy to get back. There is even competition for these cards as three subway cards, one credit card, and several debit cards can be used interchangeably with your transit card. In short, it is customer focused, consumer friendly, and feels like anything but the bureaucratic experience it is in the US.

The high-tech experience extends into the amenities as well. Subways in the US are often dead zones. In Seoul, each line provides choices of digital connectivity: 4G, WiFi, DMB, and WiBro. This supports the widespread use of IP-telephony in Seoul; without the legacy commitment to lines, almost every smart phone uses the almost universal WiFi. (More on that later.)

All of this is supported by an easy to use App, one that puts the well-regarded BART App to shame. The free App, available for all the usual platforms, works out routes and provides station by station information with precise departure and arrival times. The cost for each route and stop is computed and displayed in advance. A potential rider always knows whether to rush, and when he will arrive.

In the US, this would all be delivered through a semi-private agency, a Transit Authority. In the Seoul, the nineteen subway lines are built and operated by ten separate companies. Some routes may have a higher cost per kilometer, or per station, but that information is readily available before your ride. Fares are automatically allocated to the different companies based on the same services that compute the entire fare. With appropriate use of IT, the multi-vendor service is provided as if through a single provider.

Regular readers may recognize that this is the model of Transactive Energy.

The Seoul Metropolitan Subway system tears down assumptions about how natural are our regulated natural monopolies. To someone who considers the smart grid, it stirs re-thinking of how we consider last mile distribution in a distributed energy world. Just as South Korean phones use the connectionless protocols of the internet to avoid considerable high-cost build out of telecommunications infrastructure, transactive energy and distributed energy can provide better service at lower costs.

To gain these advantages, we must embrace the distributed multi-supplier business models that enable them. Trust capitalism. Embrace minimal market design to limit friction when changing suppliers several times a day if desired. Use IT to smooth any bumps in transition. I’ve written about this in papers on microgrids and autonomous power nodes. It was nice to see it in the field.

Finding a Needle in the Internet of Things (part 1)

Things cost what they cost to install. Ongoing charges are, in the short term, fixed. Value may be the only thing you can control. In the Internet of Things, value will be determined by how many ways you can use that Thing. Value will be determined by how many different uses can use that thing. Some of those users will be other things.

Things (as in the Internet Of…) tend to be commodities. One thing is inherently like another. Once I have more than a small number of things, I need a way to distinguish between sensors, between pieces of building equipment, and even to distinguish between tangible services such as catering and transport services. One of the first places that all of us have seen things on the internet is in conference rooms, vehicles, and tools as they are scheduled within enterprise scheduling systems.

Discovery is essential to agile integration. If systems can discover each other, we do not need to map them. If systems can understand what they discover, they can integrate themselves. One of the requirements is common semantics, that is agreements as to how something is described (or describes itself). This post is about directory directory services for the internet of things.

In Calendars, people are identified by vCards. VCards are deeply embedded in CalDav, stil the most common protocol for writing new Calendar Apps and user interfaces. Many email systems support attaching your vCard to each outgoing message. VCards are electronic business cards, and just as in traditional business cards, different people choose to include different information on them. Also like paper business cards, various companies and organizations have developed their information and format standards for vCards.

After email, the most common place to find a vCard is in a directory. There is a deep historic link between the Lightweight Directory Access Protocol (LDAP) and the vCard. LDAP is used to manage security as well as directory services in the biggest organizations. The link between directories and security is as natural as is role-based security. LDAP records include have the same variability as does the vCard standard. At some level, though, LDAP is the thing you use to get a vCard.

LDAP supports diversity of information returned, including security on particular aspects of the information. Over time, a varied set of what I will call here, for brevity, vCard profiles have been developed. These often have object-type characteristics. For example, the inetOrgPerson (RFC2798) is defined as a standard set of extensions to the organizationalPerson as defined in the ITU standard X.521. Many colleges and universities have collaborated to define the eduPerson to handle students, grad students, and faculty.

In LDAP, there is a long history returning different information about the same object in different security contexts. At universities, an LDAP will return different information when asked about a student or about staff, even when the target is the same person. Just as in medical information, the portions of student information that can be exposed to query vary widely by querier and context, and are controlled by federal privacy law. There are many security contexts, including when domestic relations go wrong, under which access to some attributes of a particular directory entry is limited. LDAP also supports multi-valued attributes easily. This is in sharp contrast with the normal expectations from, say, a SQL query.

In calendars, things that are not people are designated as Resources. Improvements to Resource vCards is a long-standing project of CalConnect. Some Resources may have a schedule, but not be schedulable. This usually means that it is scheduled by someone else using means you do not have access to, but to the user, it is not schedulable even so. Schedulable Resources may use vAvailability to indicate when and how they can be scheduled. It is of course possible, even probable, that different entities will receive a different vAvailability from the same Resource.

It will come as no surprise to my readers that I now come around to building-based resources. These are most frequently public rooms and building systems. Public rooms are invited to meetings as are other attendees. Smart buildings can optimize energy use while preserving amenity if they know when and by whom the building will be used. In a related post, I will describe how vCards for building-based resources will be standardized.

A key consumer of secure directory services for systems will be other systems. With discovery and directory services, they can find each other to interact. Through developing calendar standards, including vAvailability, they will learn when they can interact.

Secure discovery, self-integration, and autonomous assembly will be part of how we maximize the value of the internet of things.

Privacy, Self Defense, and Smart Energy

I spent some time last week down a country road, watching the local power. I watched three phases that were greatly out of balance. I observed trapezoidal wave forms. We could see the home appliances of everyone else on the road, as they each turned on and off.

Together, we watched the power coming into his lab. They were his neighbors, and he knew them from observation. He could relate when they changed their appliances, and how they lived their lives. He could tell from the patterns how they affected the shared local electric distribution circuit. There were some especially odd patterns, second level harmonics that caused some unusual recurring spikes. It wouldn’t be hard, simple machine learning, really, to learn these special patterns for some types of equipment, and then to search for them.

This is all so much easier than it was even a couple years ago. Affordable gigahertz sampling is no longer cost prohibitive. Industrial espionage can be done from across the street. Soon private detectives will be able to read the activities in houses from down the street, using only a power connection, pattern matching against an on-line database, and a little creativity. Your house and business is now an open book, with or without the participation of utilities.

This technology was not built to look out, however. Monitoring and analyzing the distribution feed is a mere side effect of the system I was checking out. The purpose of these systems is not to spy on the distribution system, but to defend against the distribution system. What we could see on the samples is also felt by the building.

The purpose of this monitoring is to fix the power inside. Each phase of power is simultaneous corrected to near ideal wave forms. The effects inside the building are extraordinary. When supplied with an ideal power wave, electric motors become audibly quieter. While that alone makes an industrial space pleasanter, it reflects an underlying reduction in vibration and in generated heat. At the same time, the motor begins to operate at its faceplate output.

This is what I mean by defense against the distribution system. Excess vibration, and the associated noise and heat, are caused by the noise on the electrical supply, by wave forms that are less than the ideal. Traditional power conditioning systems often create trapezoidal or triangular wave forms—they may protect from spikes and sags, while they increase wear and tear. It’s too early to predict how much ideal power forms will extend the life of equipment, but reduced noise and reduced heat are strong benefits on their own.

While one can hear the change in motor operation, florescent lights and digital equipment benefit as well. Long time readers of this blog know that my house is beset by something that causes even my incandescent lights to fail in clusters. Having watched the power on this nearby local distribution loop, it seems likely that I have seen the answer, even while all parameters are “within spec for home distribution.”

The plan of course, is for the local distribution to get worse. While we watched, we saw changes to power on the entire loop when the charging of a single neighbor’s electric vehicle began. Even the best solar panel installations affect these wave forms, and most installations are far from the best. The effects not only damage neighbor’s equipment, but they may increase metered power use for those neighbors as well.

Defense from the grid, especially from the smart grid is an important new market. Distributed energy resources are in all our future, and they make such defense more important.

An allied outcome of this defense is that the view from the outside is obscured. The systems behind the power controller cannot be inspected as we inspected the neighbors. Unbalanced power use, that is, power unevenly spread across the three power phases is balanced on the outside of the controller. Power factor is optimized. This ideal power load reduces metered power, often substantially. The operation of individual motors and digital systems looks from the supply-side as a single ideal consumer. Energy-use privacy is protected and restored.

As consumers, we don’t yet know how to think about and use this kind of product. As smart energy, distributed energy resources, and electric vehicles become more widely deployed, we will want to learn.

Service Oriented Scheduling (Part 1)

Some interesting new interaction patterns, and new business models, can be found by combining WS-Calendar and EMIX Terms. WS-Calendar is a specification for constructing web-services that incorporate iCalendar, the long-established basis for personal scheduling. EMIX is an information model built to support the exchange of market related information between suppliers and buyers of energy.

Service orientation names a pattern for systems interaction in which system exchange minimal information about each other. Service interactions do not specify underlying mechanisms and processes. A system that offers a service does not care which system invokes it; a service can be used by many systems. Service integration pulls system together in a manner analogous to how we build the web; we link pages and applications together without worrying what software operates each server. Service integration maximizes code re-use while enabling rapid evolution of systems.

WS-Calendar addresses the implicit assumption that all services are “instant”. Everyone knows they are not. A merchant might select a credit card processor because of a faster approval service. Still, the request is always “Approve this now!” WS-Calendar defines the messages to request “Do it tomorrow, at 9:00, and keep on doing it for one hour.” As we begin interacting with the internet of things, this capability will grow in importance.

The iCalendar family of standards is broader than the simple meeting request most of us are familiar with. iCalendar describes a family of message types: events, tasks, to-dos, et al. in the core specification, recently updated in RFC 5545. iCalendar also defines a pattern of building messages so that new types can be defined. Two new message types that are drawing interest are Availability and Polling.

vAvailability (all iCalendar message types begin with a “v”) describes how to indicate recurring patterns of time during which one is available (or unavailable). Depending upon application, other information could be included. For example, a plumber could publish a schedule (availability) with a labor rate for business hours, another schedule with rate for early evening and Saturday service, and still a third for overnight service. Availability can be stacked; that plumber can lay a short-term unavailability atop the other schedules, interrupting the standing availabilities with a vacation. vAvailability optionally includes an indication of granularity of schedule perhaps the plumber indicates a one hour minimum. Using WS-Calendar, we have a machine-readable way to advertise when a service is available for invocation.

vPoll addresses the process of “voting” for a schedule. An event organizer can send out a range of times (indicated with vAvailability) for a meeting. Recipients can rank the options, including pricing the various options. After polling, the decision of which time to select is still left to the organizer.

WS-Calendar gives us the semantic tools for machine-to-machines scheduling and optimization of resources.

In a later note, I will describe how EMIX Terms add critical additional information for service oriented interactions in the Internet of Things.