Developing Westtown Resort (1) | Kevin Wang

In my previous blog post, I briefly mentioned Westtown Resort, a project that is currently under development and is planned to be released later this year. Starting from this blog post, I will be detailing the project’s development until its release.

Introduction

Westtown Resort from a computer science class project. It was made with the objective of creating a revolution solution that allows students to have quick access to their schedules on their mobile devices. We, the seven members of the Westtown Resort team, came up with the idea of parsing the web schedule that is available to every student on MyBackpack, a school record management system, and then writing the data into an iCalendar file (a standard calendar exchange file). After such a file is created, the user would then able to import the file into their devices directly, or sync it to all of his or her devices using cloud services. The result of this is an experience that is fast and seamless. As shown in the short video clip below, users are able to access their schedule almost instantly.

 

Since the release of the first generation Westtown Resort, the feedback from our users has been overwhelmingly positive. Subsequently, we released Westtown Resort 2.0 which brought the support for semester 2 schedule and addressed many issues our users experienced in its predecessor.

A New Beginning

While current version of Westtown Resort is almost perfect, we are being driven by the demand of the student body to create the next generation Westtown Resort. We started by asking ourself the question: How might we make something that is already extraordinary even better? Our answer is to completely redesign the project from the ground up.

 

Algorithm

Our founding design of Westtown Resort relies entirely on parsing which involves the analyzation and extraction of data from a given piece of text. The user first selects, copies and pastes the schedule from MyBackpack into a text box on Resort’s webpage. This step essentially supplies the Resort with an unformatted piece of text that contains a the user’s schedule. Then, Resort begins the parsing process using a custom designed algorithm. It helps identify spaces (” “), characters (“a”), and numbers (“1”). The parser first scans for letters and number which known as the meaningful information. After it identifies the first character or letter, it continues scanning until it reaches a space, indicating an end to the particular piece of information. The parser then stores the information it just scanned and repeats the same process. Ultimately, the parser is able to extract the names, time intervals, and locations of the courses shown in the schedule.

resort_algorithm_1.001.jpeg

An explanation of the parser used in Westtown Resort 1.0 and 2.0

However, it turned out that the parser would not work properly when it encounters exceptions. For example, while most courses displays their names, time intervals, and locations on the schedule, an math independent research seminar does not come with a location. When the parser encounters such a course, it inevitably fails as it attempts to extract the course’s time interval from the blank space that is meant to be used for the course’s location.

To make the Resort more reliable, we reimagined the algorithm. Recently, we developed an new parsers that employs HTML DOM parsing. Essentially, when a student visit MyBackpack’s schedule page, he or she is actually viewing a webpage generated by the browser from an HTML file. An HTML resembles the skeleton of a webpage. It contains unformatted information, including text, image, links, etc. Since HTML by its nature is a markup language, each element (such as text) is always enclosed in between a pair of tags.

<p>Hello, world!</p>

For example, the element, “Hello!” in this case, is enclosed within two paragraph tags. “<p>” marks the beginning of the element, “</p>” marks the end of the element. Since tags in HTML always appear in pairs, the algorithm can easily identify and extract the element enclosed. In this way, a user would be instead asked to save and upload the HTML source code of the MyBackpack webpage instead of copying and pasting the plain text from the webpage.

resort_parser_2.001.jpeg

An explanation of the parser designed for the new Westtown Resort

One thought on “Developing Westtown Resort (1) | Kevin Wang

  1. willmanidis

    Kevin, I’m relatively sure you’ve mentioned this in the past as a consideration; but this in an application where OCR could really shine. It can be a bit of a pain to get running and tuned, but it will be bar none your most reliable option.

    Let me know if you need help with that, I’ve done some work with OCR systems in the past.

    Reply

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s