Find Jobs
Hire Freelancers

Custom Drupal Module for bulk entity reference import via CSV

$1500-3000 USD

Completed
Posted about 10 years ago

$1500-3000 USD

Paid on delivery
We require a custom module for Drupal 7 Our website features a territory allocation system that associates suburb/postcode combinations with territories. Node Type: Suburb Postcode Fields: Suburb (text), Postcode (4 digit number) Node Type: Territory An entity reference links Territory with Suburb Postcode -- one Territory can have anywhere from 0 to 1,000 Suburb Postcode nodes associated with it. Our website will feature approximately 300+ territories and 15,000+ suburb/postcodes and as such as require a tool for the effective management of these relationships as they change or grow over time. The data for these territories is available to us in a 15,000+ line, 400KB spreadsheet (.csv format) with columns for Suburb Name, Postcode, Territory Name. We require a module that allows us to upload this file (or portions of it) periodically to update all Territory/Suburb Postcode relationships. Given the size of the file and the sheer number of entity references it will need to update each time, the module should have appropriate load balancing settings such that it is not putting undue stress on an already busy site, and is capable of handling all 15,000+ rows of the spreadsheet. The module should disable the ability to upload a new spreadsheet while the update is in progress. This spreadsheet does not contain node IDs for the suburb/postcodes or territories, so this system will need to parse the information in the three columns to find a matching Suburb Postcode node based on the suburb and postcode fields, and matching Territory node based on the title field and build the appropriate entity reference for each. The module will not create the Territory or Suburb Postcode nodes themselves -- these will already be created -- it simply needs to build the entity references for each territory and update them each time the spreadsheet is uploaded. Sometimes it will be necessary to upload a partial spreadsheet containing only individual or several territories. As such, the module should only adjust data for territories that are included in the spreadsheet. Some updates will remove suburb/postcodes from territories and/or allocate them to another territory, so for each It will need to offer status/debugging upon completion, specifically a list of any territories or suburb/postcodes from the spreadsheet that do not match with nodes on the website, as well as the following stats: Total territories modified: # (suburb/postcodes added/subtracted) Total territories unmodified: # (no changes made) Each territory has a unique name and the node title of the territory will match exactly with the Territory. Each suburb/postcode combination is unique, however most postcodes have multiple suburbs, and there are instances of suburbs having multiple postcodes, for instance: POSTCODE | SUBURB | TERRITORY 4500 | BRAY PARK | STRATHPINE 4500 | BRENDALE | ALBANY CREEK 4500 | CASHMERE | ALBANY CREEK 4500 | CLEAR MOUNTAIN | SAMFORD 4500 | JOYNER | STRATHPINE ------------------------- 2753 | RICHMOND | CRANEBROOK 2755 | RICHMOND | CRANEBROOK 3121 | RICHMOND | HAWTHORN 4740 | RICHMOND | MACKAY The Module should be built within the overall framework of hooks etc. that Drupal provides, and should use the permissions system in Drupal to only enable use by certain roles (admin etc.). The Module should be able to be installed and operated through the standard Drupal Modules system with no core modifications. We require a developer who can work efficiently with well-written code and provide full documentation/support. Prior examples of custom Drupal module development required. The winning developer should be able to clearly sum up our requirements in their own words to demonstrate a clear understanding, and be willing to work to a very specific checklist to ensure that the Module meets our exact requirements.
Project ID: 5415359

About the project

34 proposals
Remote project
Active 10 yrs ago

Looking to make some money?

Benefits of bidding on Freelancer

Set your budget and timeframe
Get paid for your work
Outline your proposal
It's free to sign up and bid on jobs
Awarded to:
User Avatar
Hi, How are you? My name is Dario and I have over 5 years experience in Drupal all its versions (5, 6 and 7). I built some big sites like [login to view URL], [login to view URL] and [login to view URL], building cool features and integration with third-party services. I can help you buliding this custom module. I have experience importing CSV files into drupal, and also I know how to work with entity reference module. All can be done using a batch proccess to not stress server while import is running. Please don't hestiate to contact me for more details. Thanks!
$1,500 USD in 10 days
5.0 (13 reviews)
5.3
5.3
34 freelancers are bidding on average $2,204 USD for this job
User Avatar
Hello, With 99% completion rate, 650+ successfully completed projects, and a 5.00 reputation (maximum possible, 5.0) (Yes, not even 4.99 average rating, can be verified on my profile page !!)... you can never go wrong choosing me :) I look forward to your reply. Thanks. Kind Regards, Rajesh Soni
$2,577 USD in 10 days
5.0 (1035 reviews)
8.8
8.8
User Avatar
Dear Sir, I'm a PHP, CSS, HTML, JQuery, Drupal/WordPress/CiviCRM expert certified professional coder and having a lot of experience with this job. Please see my resume. I guarantee you that I can easily fulfill your needs within the time and budget . I will support Life time. you would love to work with professional who believe in long term relationships. I have checked your project and would like to have your project. I am confident to fulfill your requirements in timely manner, along with quality work. Please let me help you do it. Thanks Minh H.
$2,319 USD in 7 days
4.9 (665 reviews)
8.4
8.4
User Avatar
This is my job. I can do it. I ready begin now. ======================================================================================================================================================
$1,842 USD in 7 days
4.8 (323 reviews)
7.8
7.8
User Avatar
I am an expert in delivering custom scripts and willing to discuss further details about the project specs.
$2,368 USD in 30 days
4.8 (140 reviews)
7.4
7.4
User Avatar
will be implemented in at least 2 part process. 1. uploading (including provision for selecting server file from ftp upload) 2. parsing and updating db using background job. depending on the work the (2) may also be split up further into smaller steps to increase efficiency as well as load balancing. detailed logging/error reporting,load balancing included in bid but doesn't contain any graphics/design(see no requirements for it either)
$1,546 USD in 20 days
4.9 (157 reviews)
7.2
7.2
User Avatar
A proposal has not yet been provided
$2,368 USD in 30 days
5.0 (17 reviews)
6.7
6.7
User Avatar
I have done numerous Drupal systems with integration to 3rd party data. So I did a data import process for a travel website importing fully and incremental data of travel vacancies on a daily base. Here we were struggeling with the volume of about 100.000 records. Anyway the process did also involve various data transformations, tagging, search optimizations, etc. In your case it maybe makes sense to first upload any new files and create a "queue job" for each upload. As such the import would run as a background process to not effecting the site performance to much. The system could also be settle up in a way that any processing would run e.g. at night or varying this on the number of incoming records. Thus defining thresholds for direct or postponed processing. As the data access using the official Drupal way might be sometime pretty slow I might also optimize the system to speed the queries. I would be happy if you would like to get in touch with me regarding your project maybe also over Skype or Phone ? I am originally German but currently living and working in Istanbul. My primary goal is always to deliver quality work and stay in budget regarding time and estimate. best Carsten
$1,777 USD in 10 days
5.0 (19 reviews)
6.4
6.4
User Avatar
+++ This is my job. I'm ready to begin now. Pm for me. Thanks Looking forward to hear from you, Feel free to talk about this interesting stuff, give us any questions you have to know more about us ;-) * Europe citizen * * 30 days of FREE maintenance * Thanks Oleg!
$1,842 USD in 7 days
4.8 (106 reviews)
6.0
6.0
User Avatar
A proposal has not yet been provided
$2,319 USD in 30 days
5.0 (3 reviews)
3.4
3.4
User Avatar
Update: I really want to work on this project. CSV synchronization has been on my wish list for a while! :) Hi, I've worked for CGI for many years now which gave me several occasions to work on complex data management like the one you need. I am very familiar with entity reference and i know how to create a node programmaticaly. I already see how i will be able to create this custom module. I have many dev servers on which i can host my work for your approval. Well i would be happy to work with you if you would like :) Thank you and i hope to talk to you soon.
$1,666 USD in 20 days
5.0 (1 review)
2.8
2.8
User Avatar
Good day I worked exclusively with Drupal for over 5 years and have over the years created many custom data importing modules. My approach to your project: This will be a custom module build from scratch using the Drupal API. First will be the user interface where the CSV uploads and the reports backs will be done. User permissions will allow who can do the uploads and access the user interface. On uploading CSV file, the data will be broken up into batches and then stored in the job queue. The job queue will run with every cron run as to spread the load of the work over time so that it does not overload the system. The settings for this load distribution can be altered by admin. The job queue will run the batches where the data will first be analysed to see if it is valid, new and where some relations needs to be removed or altered. Entity relations stored or altered, after the above checks have been done, and a report back created. I hope the above short explanation gives you a clear indication of how I understand your requirements. I strictly follow the Drupal code of practices for coding Drupal modules and using the Drupal API. My code is written in a clear understandable layout with comments so that any Drupal developer can read my code. I am new to freelancer.com. I don't always work on these freelance systems and only fill up my time between other larger projects. If you have any inquiries about me and my abilities, please feel free to contact me.
$2,111 USD in 21 days
0.0 (0 reviews)
0.0
0.0

About the client

Flag of AUSTRALIA
Milton, Australia
5.0
6
Payment method verified
Member since May 7, 2013

Client Verification

Thanks! We’ve emailed you a link to claim your free credit.
Something went wrong while sending your email. Please try again.
Registered Users Total Jobs Posted
Freelancer ® is a registered Trademark of Freelancer Technology Pty Limited (ACN 142 189 759)
Copyright © 2024 Freelancer Technology Pty Limited (ACN 142 189 759)
Loading preview
Permission granted for Geolocation.
Your login session has expired and you have been logged out. Please log in again.