Browse local council websites for 15 minutes and make a big difference to PlanningAlerts.org.au

Photo by chezmichelle (flickr.com)

As you may know PlanningAlerts.org.au works by collecting development applications from many local council websites and republishes them in an easy to use way, notifying people of new applications in their area and in that way keeping you informed of things happening near you.

To do this we need to know where those applications are. So far, we know where around 60 local authorities keep their applications. There’s more than 500 local authorities that we don’t know about.

We’d like to know about a whole lot more so that PlanningAlerts can be useful to more Australians. That’s where you come in.

We’ve created a Google spreadsheet with all the local councils that we know about which we don’t yet support on PlanningAlerts.org.au and we’d like your help to fill it in.

https://spreadsheets.google.com/ccc?key=0AmvYMal8CGUsdG1tM0lEWUctR194eGN6bUh0VGFfc1E&hl=en

This is what you do. Go to the spreadsheet.

  1. Pick a council that hasn’t had all its details filled in yet (“DA’s online?” column is empty). The councils are ordered with the big councils (lots of people) at the top. So, start with those near the top if possible.
  2. Follow the link to the council website (“Website” column)
  3. Find where they store their development applications
  4. Fill in the details in “DA’s online?”, “as HTML”, “website for DA notice” columns. “DA’s online” just says whether the council publishes the development applications online. Hopefully that will be a yes. “as HTML” should be “Yes” when they publish it as a regular web page. Fill in “No” if they publish the information in PDF or Microsoft Word documents for instance. The “website for DA notice” is just a link to the page on the council website where the development applications are stored.
  5. Repeat for a few councils
  6. Add a comment to this blog post to let us and everyone else know you helped out
  7. Give yourself a big pat on the back.

Thank you in advance!

Posted in Development, PlanningAlerts.org.au | Tagged , , , | 15 Responses

Embed a PlanningAlerts Google Map in your blog

Inspired by Matthew Somerville’s post over at the mySociety blog about Embedding a FixMyStreet Google map in a blog, here’s how to embed a PlanningAlerts Google Map in your blog, like this one for Newtown, NSW:


View Larger Map

From the instructions on the API page, we can work out how to get an RSS feed for our suburb (or any other searches if you’re feeling adventurous!), just change the [state] and [suburb] parts of this URL:

http://www.planningalerts.org.au/applications.rss?state=[state]&suburb=[suburb]

  • Then go to Google Maps, paste that URL into its search box, and click Search Maps
  • Click the Link link to the top right of the map, and copy the Paste HTML to embed in website code
  • Paste that code into your blog post, sidebar, or wherever (you can alter the code to change its size etc.)

Thanks to Matthew at mySociety for the inspiration (and the better part of this blog post!). If you need any help, please don’t hesitate to sing out in the comments.

Posted in Development, PlanningAlerts.org.au | Tagged , , , | 1 Response

Search engines are how people find out about stuff

It’s an easy thing to forget when you’re building a website: people find stuff using search engines. Most of the the time they won’t remember the name of your website and decide to go there. They’ll look something up on Google or one of the miriad other search engines and it will haphazardly lead them to something on the web, useful or not.

We’d all like to think that the website we’re making is so important and so useful that people will remember the name of it, bookmark it and come back to it regularly, but chances are that just isn’t the case.

In my last post I described the early stages of building PlanningAlerts and how the website was focused purely on getting people to sign up for email alerts and how, surprise surprise, the traffic was pretty small after launch.

Since this post is about searching you probably have some ideas where this is going, but I’ll digress a little further.

There’s a lot to be learned from past experience. Looking at the statistics of visitors to OpenAustralia.org while parliament is in session we get about 75% of our traffic through search engines, and of that about 50% is coming from normal searches on Google and 25% from “paid” searches on Google (we get advertising donated by Google through their Google Grants programme) and then a small sliver from other search engines. From my understanding these numbers are fairly typical of a large site.

Another interesting thing about the OpenAustralia.org traffic is that it varies hugely between the times that parliament is in session and when it’s in recess. A large part of this is because people don’t receive email alerts when parliament is in recess. Email alerts are the way that people are reminded that there is something interesting to look at and so it’s one of the really important ways that people keep coming back to OpenAustralia.

So, basically, search is what largely brings people to OpenAustralia for the first time, but email alerts are what keep them coming back.

So, how can we apply this experience to PlanningAlerts?

The answer is surprisingly simple. PlanningAlerts has a database of a huge number of planning applications spread across the country. At the moment we kind of hide this information and only make it available to you if you sign up for an email alert. If we put that information on our website and make it searchable and browseable (and indexable by search engines) we’ll find a whole lot more people will discover PlanningAlerts.

So, how did we go about doing this?

I’ll leave the details to another post. The changes are still in progress but some of the early gains are visible now. For instance, when you get an email alert it used to be that when you wanted to find out more about the planning application it would give you a link back to the council website. Now, instead we give a link that points back to the PlanningAlerts website. Every planning application has its own page on PlanningAlerts. Here’s an example:

We’re now also actively telling search engines about those pages using sitemaps. So, every time new planning applications are found on council websites (which are usually not indexed by search engines) they’re indexed by the search engines as quickly as possible.

We’re already now seeing that the majority of searches that lead people to find PlanningAlerts are coming from people doing searches on specific street addresses. This shows that it’s working.

Posted in Development | Tagged , | Leave a comment

PlanningAlerts – going back to basics

image by Adam Foster (CC by-nc-nd)

Back in December of last year, we launched PlanningAlerts. It was a massive rush getting the site up and running. We had only seven weeks to build the site, including the scrapers, the bits of software that get all the planning data from the local council websites. We had applied to the Government 2.0 Taskforce for funding for the project and only received notice of go-ahead towards the end of November. Now, for some reason, which to this day still doesn’t make a whole lot of sense to me, they wanted every single project associated with the Taskforce wrapped up by the end of the year. So, that’s how the short deadline happened.

So, I did whatever any self-respecting developer does. I borrowed as much code as I could from elsewhere. In this case, the UK version of PlanningAlerts which was licensed as an open-source project under the GNU Public License (GPL).

That approach, similar to the way OpenAustralia was built, worked quite well. It gave me a clear target for the data that I needed to get from the local council websites through the scrapers.

The website itself did need some changing. In the UK, postcodes are really specific. They narrow things down to just a few houses on a street. This makes postcodes perfect as a quick way of specifying a location without having to give a full long-winded street address. So, the UK PlanningAlerts site uses postcodes to locate a place you want to receive planning alerts for.

Australian postcodes aren’t as specific as the UK ones. The areas of postcodes can be quite large and strangely shaped. So, postcodes are really not that great of a solution for locating a specific smallish area in Australia.

So, that meant I had to update things so that the user would enter a street address instead of a postcode. Luckily that turned out to be fairly straightforward. If my memory serves me correctly that took a little over a day to change.

So, we launched the site at the end of December to a short burst of interest. However, this time of year, towards Christmas and New Year must be about the worst possible time you could imagine to launch a new website. Everyone has other things on their mind: People to see, parties to go to, barbies to light, presents to buy…

No worries.

Fast forward a month to the end of January. We have a couple of hundred people signed up for email alerts but almost no visibility on the wider web. Relatively few people have mentioned PlanningAlerts on blogs and the like.

Time to go back to basics. What’s the point of building a service like PlanningAlerts if only a relatively small number of people use it? How can we get the message out?

The point of PlanningAlerts is to get emails of planning applications near you. Stuff comes to you in your inbox. After all, who really checks their local council website regularly for new and interesting development applications? Well clearly some people, but definitely not the majority.

So, the focus of the site is squarely on getting people to sign up for alerts. But how do you know what you’re signing up for? Well, in its current form, you just don’t.

Definitely time to go back to basics and rethink the whole experience. What came next? I’ll pick that in my next post…

Posted in Development | Tagged , , , | 5 Responses

Blog definitely not forgotten

It’s been way too long since I’ve written anything on this blog, which is very poor.

Time to turn that around. There’s lots to talk about. Because I haven’t written anything in ages I don’t really know where to start. Hmmm…

Posted in Announcement | Leave a comment

From the workshop: OpenAustralia Labs

What do you do in your spare time during a busy, week-long conference?

A) Relax
B) Have a beer
C) Set up new OpenAustralia sites

If you’re one of our volunteers, Tim ‘mithro’ Ansell or your author, Henare Degan, you answered ‘C’ – well, OK, and a bit of ‘B’ too : )

During last weeks linux.conf.au 2010, held in Wellington, New Zealand, Tim and Henare setup a new site called OpenAustralia Labs.

Labs is a place to showcase some of our more crazy experiments, or just things that aren’t quite ready for prime-time.

We have two experiments already posted to labs with more coming soon:

Register of Interests Transcriber

The Register of Interests Transcriber is Tim’s tool for turning the scanned register we opened up about a year ago into searchable passages of text. It’s been looking for a home since Tim created it a few months ago.

This is a tool we’d really like to see emerge from the labs and appear on the live OpenAustralia.org site so if you think you could help make it more polished, please check out the code and start discussing it on our Community mailing list.

Words in Parliament

This is an interesting little experiment created by Stephen Bartlett during our Melbourne hackfest. It grabs the most recent house debate and analyses the most frequently spoken words in that debate.

If you have any experiments you’d like to try out and demonstrate on OpenAustralia Labs, please don’t hesitate to discuss it on our community mailing list or create a ticket against the new Labs component on our issue tracker.

Posted in Announcement, Development | Tagged , | 1 Response

Launching our new website: Planning Alerts

You might have noticed we’ve been fairly quiet of late. Well, that’s because we’ve been hard at work putting together a new website called Planning Alerts which we’re launching today.

Planning Alerts: Email alerts of planning applications near you

We’re really excited and proud to share this with you!

You’d probably know if your next door neighbour was going to knock their house down (you’d get a letter through the door telling you they had applied for planning permission and asking you what you thought about it). But you’d probably never find out if the old cinema or pub 5 streets away is going to be converted into luxury flats until the bulldozers turned up.

PlanningAlerts.org.au is a free service which searches as many planning authority websites as it can find and emails you details of applications near you. The aim of this to enable shared scrutiny of what is being built (and knocked down) in peoples’ communities.

Planning Alerts website screenshot

PlanningAlerts.org.au is brought to you by the OpenAustralia Foundation with financial assistance from the Australian Government 2.0 Taskforce*. It was adapted for Australia by Matthew Landauer and Katherine Szuminska, and is based on the UK site PlanningAlerts.com, built by Richard Pope, Mikel Maron, Sam Smith, Duncan Parkes, Tom Hughes and Andy Armstrong.

We’re not covering all the planning authorities yet. We’re nowhere near actually. We’ve started with the 50 or so authorities with the larger populations so we’re actually covering a good percentage of the country’s population.

If you’re interested in adding a screen scraper for your local authority we’ve made it pretty easy for you. All the software that runs the site and all the screen scraper code is open-source, so please take it and have fun!

*Original link dead – archived view courtesy of The Wayback Machine <3

Posted in Announcement, PlanningAlerts.org.au | 8 Responses

Two great hackfest days!

(Cross posted to the offical Google Australia Blog)

Last weekend, OpenAustralia held its second hackfest at Google’s Sydney office. If you haven’t come across OpenAustralia.org before, it’s a volunteer run website which helps you to find out what your representatives get up to in parliament with the aim of bridging the growing democratic disconnect that many people feel.

This time we went all out with a two day hackfest – 10:30am till 8pm both days. That’s over 18 hours of hacking! As well as the venue and a fabulous team of volunteers, which included Tim Ansell, James Polley and Pamela Fox, Google provided lunch and snacks for both days. Thank you to Google for supporting this community!

It was an amazing turnout by an incredibly talented group of people. Over 90 people took part, including a surprise group from CSIRO who happened to be wandering past and dropped in to see what we were up to. We were also delighted to have 30 people take part in the first ever retroactively-named OpenAustralia installfest – installing the development virtual machine onto their laptops, and walking through the first steps showing how they can make changes to the code, test locally, and then submit to our repository on github. During the course of the hackfest, we had half a dozen or so patches pushed to us – we’re still working through the process of accepting them all! We also had 40-odd updates to bugs on our tracker.

Photos by Halans. For more fabulous photos by Halans and others see Flickr

This hackfest was timed to coincide with the Gov2.0 TaskforceMashupAustralia competition, and we encouraged people to work on mashups for the competition, OpenAustralia itself, or any other civic-minded project.

At the same time hacking on MashupAustralia on the weekend was the #melbhack session, organised by Lonely Planet and the GovHack folks.

If people weren’t in the mood for hacking, either on a mashup or OpenAustralia, we had presentations and directed hacking sessions scheduled throughout both days. Plenty for all to do.

We gave out small prizes (donated by Google) to some of our favourite mashups created over the weekend. Working demos, however rough, won out over plans, however well-formed.

Our favourite mashup, the “Suburb Matchmaker“, was created over the weekend by Raul Alberto Caceres (@totocol), Daniela Fernandez (@danira_98) and Roberto Arias Alegria (@roberto8080). It was particularly impressive that this team met over lunch on the first day and decided on the spot to work together. “Suburb Matchmaker” helps you find the suburb that’s right for you by answering some simple questions.

suburbsearch

Second place went to the “Frog Census” by Simon Swain (@psi6030). See where and when different frogs have been spotted in South Australia.

FrogCensus2

The irreverant “Bouncing Teapots” by Dan Bethell (@fxmonkeydan) and Ray Haleblian (@rhaleblian) came third. The “Bouncing Teapots” simulated members of the House of Representatives as teapots falling where the more time they spoke in parliament the more bouncy they were.

We hope that one of these or one the many other projects that were worked on over the weekend will win the MashupAustralia competition!

To follow OpenAustralia’s progress and find out when we’ll be running the next Hackfest near you please read our blog, follow us on Twitter, Facebook or join our community mailing list on Google Groups!

Posted in Announcement, Development | Tagged , , , , , , , , , , , , , , , , | 3 Responses

OpenAustralia Hackfest – MashupAustralia Edition

The OpenAustralia Foundation and Google invite you to this free all-weekend hacking extravaganza for anyone interested in creating a mashup for the MashupAustralia competition or hacking on the OpenAustralia website.

Build a cool application using data from http://data.australia.gov.au, enter it into the MashupAustralia competition and and you’re in with a chance to win prizes, including a $10,000 first prize. There’s also no better way to show the value of opening up government data then creating a practical demonstration!

We were thinking of calling the event, somewhat irreverently “iHack 2.0 – concentrated data extracts” or “Hacked Open” but in the end thought that might be a tad confusing. So, it’s simply the “OpenAustralia Hackfest – The MashupAustralia Edition”.

See our hackfest site more information and to register. Please retweet our Twitter announcement and don’t forget to tag your tweets, posts and photos with the OpenAustralia Hackfest tag #oahack.

Posted in Announcement, Development | Tagged , , , , , | 1 Response

The ups and downs of funding new projects

About two months ago we put in an application for funding to the auDA Foundation for a new project called “Planning Alerts”.

The ideas is simple.

Wouldn’t it be great if you could go to a website and put in your email address and where you live and get updates of any development applications in your area and look at them on a map? And do all of this without having to know what your local council is or how to navigate their website.

Gone would be the days when some building gets knocked down or some house gets extended without you knowing about it first.

For more details see the application in full that we submitted.

Unfortunately, last weekend we found out that the auDA Foundation Board decided not to fund our proposal. We’re obviously very disappointed but certainly not disheartened.

So, here is a call out to help us. Please read our application and tell us (by commenting on this post) what can be improved with the application. Suggest amendments and changes in approach so that next time we apply for funding, we’ll do a better job.

Also, if you have ideas for other funding organisations we should apply to for this project, let us know. We’ve also applied for funding for this project to the Government 2.0 Taskforce. We should hopefully hear back soon about that.

Posted in Announcement, Development | Tagged , , , , , , | 3 Responses